[ 546.693512] env[69360]: INFO neutron.common.config [-] Logging enabled! [ 546.693964] env[69360]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev62 [ 546.694391] env[69360]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=69360) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 546.694719] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 546.694822] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 546.695627] env[69360]: WARNING oslo_policy.policy [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 546.696017] env[69360]: WARNING oslo_policy.policy [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 546.697868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] VMware NSXv3 Agent initialized successfully. [ 546.698242] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Acquiring lock "singleton_lock" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.698434] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Acquired lock "singleton_lock" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.698659] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Releasing lock "singleton_lock" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.698959] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Full set of CONF: {{(pid=69360) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 546.699094] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ******************************************************************************** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 546.699207] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Configuration options gathered from: {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 546.699579] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 546.699760] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 546.699879] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ================================================================================ {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 546.700073] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] agent_down_time = 75 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700226] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] allow_automatic_dhcp_failover = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700369] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] allow_bulk = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700520] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] api_extensions_path = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700673] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] api_paste_config = api-paste.ini {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700818] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] auth_strategy = keystone {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.700932] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] backdoor_port = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701054] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] backdoor_socket = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701199] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] backlog = 4096 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701344] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] base_mac = fa:16:3e:00:00:00 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701507] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] bind_host = 0.0.0.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701686] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] bind_port = 9696 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701824] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] client_socket_timeout = 900 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.701976] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] config_dir = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702105] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702250] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] config_source = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702399] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] control_exchange = neutron {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702539] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] core_plugin = ml2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702692] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] debug = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.702832] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] default_availability_zones = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703054] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703207] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dhcp_agent_notification = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703349] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dhcp_agents_per_network = 1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703489] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dhcp_lease_duration = 86400 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703640] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dhcp_load_type = networks {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703785] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dns_domain = openstacklocal {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.703929] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704104] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_default_route_bfd = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704250] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_default_route_ecmp = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704389] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_dvr = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704527] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_new_agents = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704671] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_services_on_agents_with_admin_state_down = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704799] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_signals = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.704937] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] enable_traditional_dhcp = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705080] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] external_dns_driver = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705220] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] filter_validation = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705366] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] global_physnet_mtu = 8950 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705504] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] graceful_shutdown_timeout = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705687] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] host = cpu-1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705836] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] host_dvr_for_dhcp = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.705979] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] http_retries = 3 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706137] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] instance_format = [instance: %(uuid)s] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706279] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706422] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ipam_driver = internal {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706559] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ipv6_pd_enabled = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706696] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] l3_ha = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706840] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.706981] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] l3_ha_network_physical_name = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707135] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] l3_ha_network_type = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707280] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_color = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707423] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_config_append = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707566] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707702] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_dir = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707841] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_file = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.707952] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_options = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708108] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_rotate_interval = 1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708255] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_rotate_interval_type = days {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708400] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] log_rotation_type = none {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708517] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708615] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708757] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.708899] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709019] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709164] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_dns_nameservers = 5 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709302] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_header_line = 16384 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709459] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_l3_agents_per_router = 3 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709575] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_logfile_count = 30 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709735] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_logfile_size_mb = 200 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.709881] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] max_subnet_host_routes = 20 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710037] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] my_ip = 10.180.1.21 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710187] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] my_ipv6 = ::1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710323] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] network_auto_schedule = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710458] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] network_link_prefix = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710600] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710745] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] notify_nova_on_port_data_changes = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.710889] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] notify_nova_on_port_status_changes = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711041] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] pagination_max_limit = -1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711186] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] publish_errors = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711325] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rate_limit_burst = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711471] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rate_limit_except_level = CRITICAL {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711609] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rate_limit_interval = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711774] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] retry_until_window = 30 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.711918] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] router_distributed = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712070] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rpc_resources_processing_step = 20 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712212] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rpc_response_max_timeout = 600 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712352] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] rpc_response_timeout = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712490] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] send_events_interval = 2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712647] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] service_plugins = ['router'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712791] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] setproctitle = on {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.712925] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] shell_completion = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713086] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] state_path = /opt/stack/data/neutron {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713233] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] syslog_log_facility = LOG_USER {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713373] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] tcp_keepidle = 600 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713520] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] transport_url = **** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713659] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] use_journal = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713797] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] use_json = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.713934] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] use_ssl = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714105] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] use_stderr = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714255] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] use_syslog = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714394] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vlan_qinq = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714532] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vlan_transparent = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714669] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] watch_log_file = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714808] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] wsgi_default_pool_size = 100 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.714946] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] wsgi_keep_alive = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.715105] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.715244] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] wsgi_server_debug = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 546.715402] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_concurrency.disable_process_locking = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.715555] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.715708] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.715854] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716009] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716166] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716314] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716467] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.connection_string = messaging:// {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716617] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.enabled = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716767] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.es_doc_type = notification {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.716912] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.es_scroll_size = 10000 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717075] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.es_scroll_time = 2m {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717226] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.filter_error_trace = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717379] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.hmac_keys = **** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717528] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.sentinel_service_name = mymaster {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717684] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.socket_timeout = 0.1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717833] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.trace_requests = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.717976] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler.trace_sqlalchemy = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.718148] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler_jaeger.process_tags = {} {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.718290] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler_jaeger.service_name_prefix = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.718431] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] profiler_otlp.service_name_prefix = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.718585] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.enforce_new_defaults = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.718861] env[69360]: WARNING oslo_config.cfg [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 546.719028] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.enforce_scope = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719182] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.policy_default_rule = default {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719341] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719490] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719645] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719810] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.719956] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720096] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720237] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720385] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_policy.remote_timeout = 60.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720538] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720695] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] agent.extensions = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720836] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.720987] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] service_providers.service_provider = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721152] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.default_quota = -1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721303] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721446] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_floatingip = 50 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721588] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_network = 100 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721753] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_port = 500 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.721902] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_rbac_policy = 10 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722057] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_router = 10 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722203] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_security_group = 10 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722344] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_security_group_rule = 100 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722487] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.quota_subnet = 100 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722631] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] QUOTAS.track_quota_usage = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722787] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.722928] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723079] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723226] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723392] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723513] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723654] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723804] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.723944] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724119] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724263] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724408] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724552] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724691] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_dhcp_release.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724843] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.724985] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725138] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725280] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725425] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725569] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725713] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_ovs_vsctl.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.725864] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.capabilities = [21] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726016] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726162] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726309] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726458] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726608] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726760] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_namespace.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.726896] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.capabilities = [12] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727049] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727191] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727335] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727481] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727625] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727765] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_conntrack.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.727916] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.capabilities = [12, 21] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728066] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.group = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728208] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.helper_command = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728351] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.log_daemon_traceback = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728499] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728639] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.thread_pool_size = 8 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728780] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] privsep_link.user = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.728941] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729105] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729253] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.continue_on_failed_promotions = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729395] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.dscp = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729544] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.dscp_inherit = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729716] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.force_mp_to_policy = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.729875] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.locking_coordinator_url = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730035] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.log_agent_heartbeats = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730184] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.logging_expire = 1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730341] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730498] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730652] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.polling_interval = 240 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730801] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.730953] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.quitting_rpc_timeout = 120 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731115] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.report_interval = 30.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731269] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731422] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731569] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731751] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.sync_skew = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.731903] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.synchronization_queue_size = 20 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732060] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT.use_helper_for_ns_read = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732216] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] SECURITYGROUP.enable_ipset = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732370] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] SECURITYGROUP.enable_security_group = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732520] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732671] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732823] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] experimental.ipv6_pd_enabled = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.732989] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.extension_drivers = ['port_security'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733144] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.external_network_type = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733303] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733455] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.overlay_ip_version = 4 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733605] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.path_mtu = 8950 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733753] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.physical_network_mtus = {} {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.733908] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.tenant_network_types = ['vlan'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734090] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734252] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ml2.type_drivers = ['vlan'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734407] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT_CLI.neutron_port_id = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734555] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734696] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.734856] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735015] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735171] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735320] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735472] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735622] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735825] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.735984] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_login_password = **** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736148] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_login_port = 443 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736297] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_login_user = admin {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736445] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736596] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736765] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.736880] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737077] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737184] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737334] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737485] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737627] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737777] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.737929] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738082] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738235] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738434] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738589] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vsphere.vsphere_login_password = VMware1! {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738737] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.738882] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739040] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.auth_section = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739198] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.auth_type = password {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739346] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739484] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.certfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739629] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.collect_timing = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739806] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.endpoint_type = public {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.739956] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.insecure = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740104] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.keyfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740257] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.region_name = RegionOne {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740402] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.split_loggers = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740541] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] nova.timeout = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740686] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.auth_section = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740838] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.auth_type = password {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.740985] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741136] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.certfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741291] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.collect_timing = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741420] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.endpoint_type = public {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741562] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.insecure = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741722] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.keyfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.741870] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.region_name = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742018] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.split_loggers = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742162] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] placement.timeout = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742310] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.auth_section = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742453] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.auth_type = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742591] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.cafile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742731] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.certfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.742876] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.collect_timing = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743024] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.connect_retries = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743169] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.connect_retry_delay = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743310] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.enable_notifications = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743448] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.endpoint_override = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743592] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.insecure = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743728] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.interface = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.743866] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.keyfile = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744039] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.max_version = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744194] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.min_version = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744334] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.region_name = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744469] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.retriable_status_codes = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744605] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.service_name = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744743] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.service_type = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.744886] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.split_loggers = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745037] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.status_code_retries = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745175] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.status_code_retry_delay = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745311] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.timeout = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745447] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.valid_interfaces = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745582] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ironic.version = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745728] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] cli_script.dry_run = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.745882] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746035] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746184] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746326] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746469] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746611] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746753] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.746895] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747046] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747199] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747393] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747484] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747633] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747780] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.747925] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748083] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748230] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748371] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748518] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748660] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748801] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.748942] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749091] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749233] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749372] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749512] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749668] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749823] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.749966] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750126] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750307] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750414] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750565] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750697] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750843] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.750990] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.ssl_version = {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751216] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751291] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_notifications.driver = [] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751435] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_notifications.retry = -1 {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751592] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751766] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] oslo_messaging_notifications.transport_url = **** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 546.751880] env[69360]: DEBUG oslo_service.backend.eventlet.service [None req-4d7f0838-3444-4f2a-9bdc-938f3880236e None None] ******************************************************************************** {{(pid=69360) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 546.752895] env[69360]: DEBUG neutron.agent.securitygroups_rpc [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Init firewall settings (driver=nsxv3) {{(pid=69360) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 546.754220] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=69360) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 546.754465] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] RPC agent_id: nsxm-l-01a.corp.local [ 546.757070] env[69360]: DEBUG dogpile.cache.region [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 546.757226] env[69360]: DEBUG dogpile.lock [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 546.757332] env[69360]: DEBUG dogpile.lock [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 546.757428] env[69360]: DEBUG dogpile.lock [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 546.757528] env[69360]: DEBUG dogpile.cache.region [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 546.757622] env[69360]: DEBUG dogpile.lock [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 546.757748] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 546.799072] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Session token - acquiring [ 546.800785] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.800984] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.801118] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.801554] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.812874] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.102978] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 547.125494] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 547.125670] env[69360]: DEBUG dogpile.cache.region [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Cache value generated in 0.368 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 547.125809] env[69360]: DEBUG dogpile.lock [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 547.125935] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Activating Policy API Provider. [ 547.126177] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Looking for the default Infrastructure Rules. [ 547.193270] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Looking for the Default Layer3 Logged Drop Section. [ 547.208643] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 547.209134] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.209342] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.209456] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.209927] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.210290] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.724590] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.227506] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.730354] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Inventory metadata is going to be refreshed. [ 548.730761] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.644375] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.644589] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.644748] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.645023] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.656256] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.657153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.657993] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.677439] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.677677] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.677776] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.678051] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.678189] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.678338] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.678457] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.678567] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 549.702021] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.702260] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.702300] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.702629] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.702820] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.702973] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.722993] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.723215] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.723326] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.723583] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.723733] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.723881] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.743817] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.744357] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.744357] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.744543] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.744698] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.744860] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 549.744971] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.745096] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 549.763636] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.763926] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.763926] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.764231] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.764360] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.764507] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 549.764618] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.764829] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 549.787556] env[69360]: DEBUG networking_nsxv3.common.locking [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.787777] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.787983] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.788329] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.788479] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.788646] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 549.788757] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.788861] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Inventory metadata have been refreshed. [ 549.788962] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Dryrun:True. Metadata refresh completed. [ 549.789094] env[69360]: DEBUG oslo_concurrency.lockutils [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Releasing lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.791053] env[69360]: INFO neutron.agent.agent_extensions_manager [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Loaded agent extensions: [] [ 549.792303] env[69360]: DEBUG neutron_lib.callbacks.manager [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=69360) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 549.850370] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent RPC Daemon Started! [ 549.850531] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:0 started [ 549.850588] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent out of sync with plugin! [ 554.792015] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.792387] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.793436] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.793808] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 564.652067] env[69360]: INFO networking_nsxv3.common.synchronization [None req-75932b2a-0178-4ccd-89a6-3aebd6d9c964 demo admin] Enqueued Resource ID: aec178f4-7400-42bd-ab6a-25efdc0b53ec with Priority: HIGHEST for action security_group_rules [ 564.652067] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec178f4-7400-42bd-ab6a-25efdc0b53ec with Priority: HIGHEST for action security_group_rules [ 564.652409] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aec178f4-7400-42bd-ab6a-25efdc0b53ec taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.652473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aec178f4-7400-42bd-ab6a-25efdc0b53ec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.652510] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aec178f4-7400-42bd-ab6a-25efdc0b53ec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.652873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aec178f4-7400-42bd-ab6a-25efdc0b53ec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.652955] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aec178f4-7400-42bd-ab6a-25efdc0b53ec',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.173641] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.173641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.173641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.173641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.173641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.173641] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aec178f4-7400-42bd-ab6a-25efdc0b53ec already deleted. [ 565.173641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aec178f4-7400-42bd-ab6a-25efdc0b53ec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.794738] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.795094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.795094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.795212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.795405] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.299695] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.802492] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.304796] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 567.304973] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 568.133110] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.133553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.133553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.133553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.145386] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 568.146193] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.146796] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 568.163480] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.163672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.163672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.163884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.163969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.164115] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 568.164194] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 568.164265] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 568.183208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.183384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.183417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.183612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.183746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.183860] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 568.208225] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.208527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.208527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.208633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.208747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.208865] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 568.228337] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.228551] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.228551] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.228738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.228842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.228957] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 568.229039] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 568.229110] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 568.245868] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.246072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.246072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.246285] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.246375] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.246483] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 568.246556] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 568.246628] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 568.267291] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.267550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.267550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.267831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.267974] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.268152] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 568.268252] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 568.268344] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 568.268435] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 568.268537] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 568.268623] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 568.268708] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 568.269067] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 568.269162] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 568.269263] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 568.288725] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.288937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.288937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.289171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.289278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.289391] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 568.310934] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.311194] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.311194] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.311352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.311457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.324413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.653693] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 569.654142] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 574.655212] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 574.655618] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 579.656338] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 579.656770] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 584.657417] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 584.658880] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 589.660014] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 589.660320] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 593.248617] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f4322356-35a6-4694-93e0-dac10e79bbc7 None None] Enqueued Resource ID: 2e090b92-8a56-44f0-8b5f-59de12222e29 with Priority: HIGHEST for action port [ 593.249162] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e090b92-8a56-44f0-8b5f-59de12222e29 with Priority: HIGHEST for action port [ 593.249456] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e090b92-8a56-44f0-8b5f-59de12222e29 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.249785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e090b92-8a56-44f0-8b5f-59de12222e29" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.249785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e090b92-8a56-44f0-8b5f-59de12222e29" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.249911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e090b92-8a56-44f0-8b5f-59de12222e29" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.250278] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e090b92-8a56-44f0-8b5f-59de12222e29',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.634726] env[69360]: INFO networking_nsxv3.common.synchronization [None req-20f751e2-426a-442f-b2bc-57f7d2ad75ec None None] Enqueued Resource ID: fbe6376d-3d34-4b86-9dcd-5ea8b35142c1 with Priority: HIGHEST for action port [ 593.635669] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe6376d-3d34-4b86-9dcd-5ea8b35142c1 with Priority: HIGHEST for action port [ 593.637383] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe6376d-3d34-4b86-9dcd-5ea8b35142c1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.637383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe6376d-3d34-4b86-9dcd-5ea8b35142c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.637383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe6376d-3d34-4b86-9dcd-5ea8b35142c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.637383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe6376d-3d34-4b86-9dcd-5ea8b35142c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.637383] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe6376d-3d34-4b86-9dcd-5ea8b35142c1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.752887] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e090b92-8a56-44f0-8b5f-59de12222e29 [ 593.753135] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.753263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.753330] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.753537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.753624] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.753715] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e090b92-8a56-44f0-8b5f-59de12222e29 already deleted. [ 593.753793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e090b92-8a56-44f0-8b5f-59de12222e29" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.140066] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbe6376d-3d34-4b86-9dcd-5ea8b35142c1 [ 594.140287] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.140413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.140481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.140681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.140777] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.140917] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbe6376d-3d34-4b86-9dcd-5ea8b35142c1 already deleted. [ 594.140950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe6376d-3d34-4b86-9dcd-5ea8b35142c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.321381] env[69360]: INFO networking_nsxv3.common.synchronization [None req-1b12d8ff-625b-4e3c-8eb2-13f43d67228e None None] Enqueued Resource ID: 570f3a55-cefd-4719-b2aa-557499807e36 with Priority: HIGHEST for action port [ 594.321381] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 570f3a55-cefd-4719-b2aa-557499807e36 with Priority: HIGHEST for action port [ 594.321381] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-570f3a55-cefd-4719-b2aa-557499807e36 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.321381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-570f3a55-cefd-4719-b2aa-557499807e36" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.321381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-570f3a55-cefd-4719-b2aa-557499807e36" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.321882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-570f3a55-cefd-4719-b2aa-557499807e36" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.321882] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('570f3a55-cefd-4719-b2aa-557499807e36',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.825259] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 570f3a55-cefd-4719-b2aa-557499807e36 [ 594.825467] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.825836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.825836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.825963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.825963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.826197] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:570f3a55-cefd-4719-b2aa-557499807e36 already deleted. [ 594.826197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-570f3a55-cefd-4719-b2aa-557499807e36" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.691310] env[69360]: INFO networking_nsxv3.common.synchronization [None req-397a4a30-a7df-42a6-bb5b-a2978f3df76c None None] Enqueued Resource ID: 74051873-4151-430b-97bc-aa85079dc17c with Priority: HIGHEST for action port [ 595.691554] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74051873-4151-430b-97bc-aa85079dc17c with Priority: HIGHEST for action port [ 595.692137] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-74051873-4151-430b-97bc-aa85079dc17c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.692262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74051873-4151-430b-97bc-aa85079dc17c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.692369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74051873-4151-430b-97bc-aa85079dc17c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.698165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74051873-4151-430b-97bc-aa85079dc17c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.698165] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74051873-4151-430b-97bc-aa85079dc17c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.039346] env[69360]: INFO networking_nsxv3.common.synchronization [None req-655b5a12-1737-4f39-9a22-503414e44ad8 None None] Enqueued Resource ID: 549c3f16-3d93-4459-9ff0-a5a3dbf94db3 with Priority: HIGHEST for action port [ 596.039725] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549c3f16-3d93-4459-9ff0-a5a3dbf94db3 with Priority: HIGHEST for action port [ 596.040244] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-549c3f16-3d93-4459-9ff0-a5a3dbf94db3 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.040379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-549c3f16-3d93-4459-9ff0-a5a3dbf94db3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.040448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-549c3f16-3d93-4459-9ff0-a5a3dbf94db3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.040694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-549c3f16-3d93-4459-9ff0-a5a3dbf94db3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.040777] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('549c3f16-3d93-4459-9ff0-a5a3dbf94db3',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.197863] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74051873-4151-430b-97bc-aa85079dc17c [ 596.198183] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.198305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.198305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.198550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.198632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.198695] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74051873-4151-430b-97bc-aa85079dc17c already deleted. [ 596.198783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74051873-4151-430b-97bc-aa85079dc17c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.545668] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 549c3f16-3d93-4459-9ff0-a5a3dbf94db3 [ 596.545985] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.546229] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.546229] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.546937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.546937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.546937] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:549c3f16-3d93-4459-9ff0-a5a3dbf94db3 already deleted. [ 596.546937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-549c3f16-3d93-4459-9ff0-a5a3dbf94db3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.772576] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7974d06c-16e0-4372-9085-6aa36d76300e None None] Enqueued Resource ID: 4f3f4a03-2f85-4194-becd-38a85c5266bd with Priority: HIGHEST for action port [ 596.772576] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f3f4a03-2f85-4194-becd-38a85c5266bd with Priority: HIGHEST for action port [ 596.772576] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f3f4a03-2f85-4194-becd-38a85c5266bd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.772576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f3f4a03-2f85-4194-becd-38a85c5266bd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.772576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f3f4a03-2f85-4194-becd-38a85c5266bd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.772576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f3f4a03-2f85-4194-becd-38a85c5266bd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.772576] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f3f4a03-2f85-4194-becd-38a85c5266bd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.967511] env[69360]: INFO networking_nsxv3.common.synchronization [None req-243bccdc-e8b2-443f-8ec0-4512a4b46432 None None] Enqueued Resource ID: 0f3adde9-d225-4e53-ab0d-55c42dab6334 with Priority: HIGHEST for action port [ 596.967511] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f3adde9-d225-4e53-ab0d-55c42dab6334 with Priority: HIGHEST for action port [ 596.968473] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f3adde9-d225-4e53-ab0d-55c42dab6334 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.968473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f3adde9-d225-4e53-ab0d-55c42dab6334" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.968473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f3adde9-d225-4e53-ab0d-55c42dab6334" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.968473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f3adde9-d225-4e53-ab0d-55c42dab6334" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.968672] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f3adde9-d225-4e53-ab0d-55c42dab6334',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.277205] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f3f4a03-2f85-4194-becd-38a85c5266bd [ 597.277394] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.277608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.277608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.277922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.277922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.278032] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f3f4a03-2f85-4194-becd-38a85c5266bd already deleted. [ 597.278068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f3f4a03-2f85-4194-becd-38a85c5266bd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.288228] env[69360]: INFO networking_nsxv3.common.synchronization [None req-fdf6413b-c56b-48c2-b44c-430edba4970b None None] Enqueued Resource ID: a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50 with Priority: HIGHEST for action port [ 597.288228] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50 with Priority: HIGHEST for action port [ 597.288228] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.288228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.288228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.289041] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.290046] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.361775] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8c320db5-9895-478a-b6fc-64b68501b499 None None] Enqueued Resource ID: cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5 with Priority: HIGHEST for action port [ 597.362580] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5 with Priority: HIGHEST for action port [ 597.362621] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.362747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.362788] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.363778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.363778] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.470689] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f3adde9-d225-4e53-ab0d-55c42dab6334 [ 597.470689] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.471280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.471415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.471686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.471803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.471915] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f3adde9-d225-4e53-ab0d-55c42dab6334 already deleted. [ 597.472009] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f3adde9-d225-4e53-ab0d-55c42dab6334" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.659283] env[69360]: INFO networking_nsxv3.common.synchronization [None req-e00bbedd-7609-4a81-9988-58c7e5ad17f8 tempest-ServersTestBootFromVolume-945135387 tempest-ServersTestBootFromVolume-945135387-project-member] Enqueued Resource ID: 94bfd687-808a-4ffa-af42-895ec4570b44 with Priority: HIGHEST for action security_group_rules [ 597.659842] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94bfd687-808a-4ffa-af42-895ec4570b44 with Priority: HIGHEST for action security_group_rules [ 597.660210] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94bfd687-808a-4ffa-af42-895ec4570b44 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.660529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.660529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.660734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.660844] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94bfd687-808a-4ffa-af42-895ec4570b44',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.771299] env[69360]: INFO networking_nsxv3.common.synchronization [None req-e2acfd1d-a999-4671-8b26-12ee54aac450 tempest-ServersTestBootFromVolume-945135387 tempest-ServersTestBootFromVolume-945135387-project-member] Enqueued Resource ID: 94bfd687-808a-4ffa-af42-895ec4570b44 with Priority: HIGHEST for action security_group_rules [ 597.771824] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94bfd687-808a-4ffa-af42-895ec4570b44 with Priority: HIGHEST for action security_group_rules [ 597.772146] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94bfd687-808a-4ffa-af42-895ec4570b44 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.772413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.793506] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50 [ 597.795293] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.795293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.795293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.795293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.795293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.795293] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50 already deleted. [ 597.795293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3852c3e-4b4d-4ce3-a3e0-0935e27ffe50" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.868578] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5 [ 597.868578] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.868578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.868578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.868578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.868578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.868578] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5 already deleted. [ 597.868578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb22e5ab-fd41-4e73-ab6d-f88ca1325aa5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.185159] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.185341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.185384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.185592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.185685] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.185783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94bfd687-808a-4ffa-af42-895ec4570b44 already deleted. [ 598.185867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.186060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.186191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.186270] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94bfd687-808a-4ffa-af42-895ec4570b44',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.709165] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.709360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.709442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.709663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.709754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.709849] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94bfd687-808a-4ffa-af42-895ec4570b44 already deleted. [ 598.709929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94bfd687-808a-4ffa-af42-895ec4570b44" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.761280] env[69360]: INFO networking_nsxv3.common.synchronization [None req-73a3506e-c04b-48f3-ac1f-fbf069b69628 None None] Enqueued Resource ID: 28365167-6d5f-4710-86cc-3b6c731b9d8d with Priority: HIGHEST for action port [ 601.761280] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28365167-6d5f-4710-86cc-3b6c731b9d8d with Priority: HIGHEST for action port [ 601.761280] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-28365167-6d5f-4710-86cc-3b6c731b9d8d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.761280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28365167-6d5f-4710-86cc-3b6c731b9d8d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.761280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28365167-6d5f-4710-86cc-3b6c731b9d8d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.762780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28365167-6d5f-4710-86cc-3b6c731b9d8d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.762881] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28365167-6d5f-4710-86cc-3b6c731b9d8d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.023376] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7b63c8e2-3fd9-412c-a300-0524ed630c2b None None] Enqueued Resource ID: 4d02722e-e9ec-4950-a625-c6485c0c5af7 with Priority: HIGHEST for action port [ 602.026278] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d02722e-e9ec-4950-a625-c6485c0c5af7 with Priority: HIGHEST for action port [ 602.026278] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d02722e-e9ec-4950-a625-c6485c0c5af7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.026278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d02722e-e9ec-4950-a625-c6485c0c5af7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.026278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d02722e-e9ec-4950-a625-c6485c0c5af7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.026278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d02722e-e9ec-4950-a625-c6485c0c5af7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.026278] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d02722e-e9ec-4950-a625-c6485c0c5af7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.170331] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5e7c3b19-a3b0-4c93-93e2-d2b8be772a7d tempest-ServersTestManualDisk-924480253 tempest-ServersTestManualDisk-924480253-project-member] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 602.170331] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 602.170331] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.170331] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.170331] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.170331] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.170331] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.265040] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28365167-6d5f-4710-86cc-3b6c731b9d8d [ 602.265671] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.265671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.265671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.266067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.266067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.266067] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28365167-6d5f-4710-86cc-3b6c731b9d8d already deleted. [ 602.266067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28365167-6d5f-4710-86cc-3b6c731b9d8d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.297362] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3ba84588-8fd8-44cf-8d7c-803e80fec20e tempest-ServersTestManualDisk-924480253 tempest-ServersTestManualDisk-924480253-project-member] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 602.298954] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 602.299288] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.299399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.527638] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d02722e-e9ec-4950-a625-c6485c0c5af7 [ 602.527866] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.528025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.528082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.528305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.528400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.528502] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d02722e-e9ec-4950-a625-c6485c0c5af7 already deleted. [ 602.528585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d02722e-e9ec-4950-a625-c6485c0c5af7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.609464] env[69360]: INFO networking_nsxv3.common.synchronization [None req-d6a355b0-67bf-4cee-9376-7a81fbf12b6c None None] Enqueued Resource ID: 54f77937-b131-418b-92bf-7ca938f91819 with Priority: HIGHEST for action port [ 602.609649] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54f77937-b131-418b-92bf-7ca938f91819 with Priority: HIGHEST for action port [ 602.612020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-54f77937-b131-418b-92bf-7ca938f91819 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.612020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54f77937-b131-418b-92bf-7ca938f91819" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.612020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54f77937-b131-418b-92bf-7ca938f91819" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.612020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54f77937-b131-418b-92bf-7ca938f91819" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.612020] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54f77937-b131-418b-92bf-7ca938f91819',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.696354] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.696516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.696604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.697291] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.698107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.698107] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f already deleted. [ 602.698107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.698107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.698107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.698107] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.005116] env[69360]: INFO networking_nsxv3.common.synchronization [None req-dd3605e6-9920-44be-a8c8-65f98ae1c0e7 None None] Enqueued Resource ID: 4831833d-bda9-4ec5-bce2-369e433d05ff with Priority: HIGHEST for action port [ 603.005712] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4831833d-bda9-4ec5-bce2-369e433d05ff with Priority: HIGHEST for action port [ 603.006615] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4831833d-bda9-4ec5-bce2-369e433d05ff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.007060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4831833d-bda9-4ec5-bce2-369e433d05ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.007600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4831833d-bda9-4ec5-bce2-369e433d05ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.007600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4831833d-bda9-4ec5-bce2-369e433d05ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.007600] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4831833d-bda9-4ec5-bce2-369e433d05ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.070208] env[69360]: INFO networking_nsxv3.common.synchronization [None req-34160232-6fe2-4af9-b145-b557f4ce682f None None] Enqueued Resource ID: 48701ad4-72f9-49e5-a9d2-60d32463f562 with Priority: HIGHEST for action port [ 603.070208] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48701ad4-72f9-49e5-a9d2-60d32463f562 with Priority: HIGHEST for action port [ 603.070208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-48701ad4-72f9-49e5-a9d2-60d32463f562 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.070208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48701ad4-72f9-49e5-a9d2-60d32463f562" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.070208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48701ad4-72f9-49e5-a9d2-60d32463f562" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.070208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48701ad4-72f9-49e5-a9d2-60d32463f562" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.070208] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48701ad4-72f9-49e5-a9d2-60d32463f562',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.113089] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54f77937-b131-418b-92bf-7ca938f91819 [ 603.113326] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.113810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.113810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.113810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.114015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.114015] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54f77937-b131-418b-92bf-7ca938f91819 already deleted. [ 603.114015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54f77937-b131-418b-92bf-7ca938f91819" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.224699] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.224870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.224936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.225173] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.225260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.225353] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f already deleted. [ 603.225431] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.510101] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4831833d-bda9-4ec5-bce2-369e433d05ff [ 603.510953] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.510953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.510953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.510953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.510953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.510953] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4831833d-bda9-4ec5-bce2-369e433d05ff already deleted. [ 603.511371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4831833d-bda9-4ec5-bce2-369e433d05ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.575437] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48701ad4-72f9-49e5-a9d2-60d32463f562 [ 603.575673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.575809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.575865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.576073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.576162] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.576261] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48701ad4-72f9-49e5-a9d2-60d32463f562 already deleted. [ 603.576342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48701ad4-72f9-49e5-a9d2-60d32463f562" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.109657] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0c898ba7-dd99-49eb-8c7e-a432321edc9f None None] Enqueued Resource ID: e26ff5c8-e124-421f-92a8-be158fe02682 with Priority: HIGHEST for action port [ 604.110234] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26ff5c8-e124-421f-92a8-be158fe02682 with Priority: HIGHEST for action port [ 604.113982] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26ff5c8-e124-421f-92a8-be158fe02682 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.113982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26ff5c8-e124-421f-92a8-be158fe02682" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.113982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26ff5c8-e124-421f-92a8-be158fe02682" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.113982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26ff5c8-e124-421f-92a8-be158fe02682" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.113982] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26ff5c8-e124-421f-92a8-be158fe02682',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.617550] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e26ff5c8-e124-421f-92a8-be158fe02682 [ 604.617796] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.617954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.618020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.618239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.618333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.618432] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e26ff5c8-e124-421f-92a8-be158fe02682 already deleted. [ 604.618525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26ff5c8-e124-421f-92a8-be158fe02682" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.328549] env[69360]: INFO networking_nsxv3.common.synchronization [None req-31623973-1b17-4ed5-856e-1e9863e430e6 None None] Enqueued Resource ID: 5e0acb9a-ba91-4769-a18e-402fc1812f6e with Priority: HIGHEST for action port [ 605.328549] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0acb9a-ba91-4769-a18e-402fc1812f6e with Priority: HIGHEST for action port [ 605.328549] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0acb9a-ba91-4769-a18e-402fc1812f6e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.328549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0acb9a-ba91-4769-a18e-402fc1812f6e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.328549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0acb9a-ba91-4769-a18e-402fc1812f6e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.328549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0acb9a-ba91-4769-a18e-402fc1812f6e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.328549] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0acb9a-ba91-4769-a18e-402fc1812f6e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.829495] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e0acb9a-ba91-4769-a18e-402fc1812f6e [ 605.831528] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.831858] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.831858] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.832047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.832192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.832308] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e0acb9a-ba91-4769-a18e-402fc1812f6e already deleted. [ 605.832401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0acb9a-ba91-4769-a18e-402fc1812f6e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.444148] env[69360]: INFO networking_nsxv3.common.synchronization [None req-9a10f814-7b9e-4c2e-936e-320d4bdf3d8d None None] Enqueued Resource ID: 5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6 with Priority: HIGHEST for action port [ 609.444665] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6 with Priority: HIGHEST for action port [ 609.446918] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.447099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.447174] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.451251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.451341] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.815403] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8c14e92d-c70e-4b3b-809b-39f56cd035d0 None None] Enqueued Resource ID: 4a1bb21a-e96a-483b-bb4c-319e6090369a with Priority: HIGHEST for action port [ 609.815636] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a1bb21a-e96a-483b-bb4c-319e6090369a with Priority: HIGHEST for action port [ 609.817182] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a1bb21a-e96a-483b-bb4c-319e6090369a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.817319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a1bb21a-e96a-483b-bb4c-319e6090369a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.817389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a1bb21a-e96a-483b-bb4c-319e6090369a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.817650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a1bb21a-e96a-483b-bb4c-319e6090369a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.817727] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a1bb21a-e96a-483b-bb4c-319e6090369a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.953538] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6 [ 609.953893] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.953893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.953893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.954299] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.954299] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.956437] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6 already deleted. [ 609.956437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5012711f-1dd0-4ba9-8a2e-d9b1f1f3e4d6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.313786] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6825c110-ea79-4c71-a9ad-3be64aa40e0b tempest-VolumesAssistedSnapshotsTest-171649522 tempest-VolumesAssistedSnapshotsTest-171649522-project-member] Enqueued Resource ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 with Priority: HIGHEST for action security_group_rules [ 610.314349] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 with Priority: HIGHEST for action security_group_rules [ 610.314655] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.315350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.315350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.315350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.315350] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea2a277-9a95-4e9e-8fe7-677b4d405cd4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.322279] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a1bb21a-e96a-483b-bb4c-319e6090369a [ 610.322279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.322279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.322279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.322279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.322279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.322568] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a1bb21a-e96a-483b-bb4c-319e6090369a already deleted. [ 610.322568] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a1bb21a-e96a-483b-bb4c-319e6090369a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.660387] env[69360]: INFO networking_nsxv3.common.synchronization [None req-76efdb03-5745-4f3c-8dc8-8fdbb177e009 tempest-VolumesAssistedSnapshotsTest-171649522 tempest-VolumesAssistedSnapshotsTest-171649522-project-member] Enqueued Resource ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 with Priority: HIGHEST for action security_group_rules [ 610.661043] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 with Priority: HIGHEST for action security_group_rules [ 610.661286] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.661417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.748235] env[69360]: INFO networking_nsxv3.common.synchronization [None req-4f719a13-753e-443a-bf33-1e530f953c47 None None] Enqueued Resource ID: 94c2c94f-175c-4b4b-b867-704e1305affb with Priority: HIGHEST for action port [ 610.748879] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94c2c94f-175c-4b4b-b867-704e1305affb with Priority: HIGHEST for action port [ 610.749187] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-94c2c94f-175c-4b4b-b867-704e1305affb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.749701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94c2c94f-175c-4b4b-b867-704e1305affb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.749881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94c2c94f-175c-4b4b-b867-704e1305affb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.750198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94c2c94f-175c-4b4b-b867-704e1305affb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.750286] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94c2c94f-175c-4b4b-b867-704e1305affb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.787645] env[69360]: INFO networking_nsxv3.common.synchronization [req-e5c55306-db19-47a1-ba30-976ca079999c req-06d38403-6699-40b9-8c2e-7f5d7dafd7e4 tempest-ServerDiagnosticsTest-302831517 tempest-ServerDiagnosticsTest-302831517-project-member] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 610.787645] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 610.787645] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.787645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.787645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.787986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.788090] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.789550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.789550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.789550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.789550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.789550] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.842182] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.842182] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 already deleted. [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.842182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.842182] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dea2a277-9a95-4e9e-8fe7-677b4d405cd4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.071641] env[69360]: INFO networking_nsxv3.common.synchronization [None req-c91fddfe-1ff3-431b-bb1e-463daf365dfc None None] Enqueued Resource ID: 764daf2a-17fe-4089-a9e7-91c95a8003af with Priority: HIGHEST for action port [ 611.074029] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 764daf2a-17fe-4089-a9e7-91c95a8003af with Priority: HIGHEST for action port [ 611.074029] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-764daf2a-17fe-4089-a9e7-91c95a8003af taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.074029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-764daf2a-17fe-4089-a9e7-91c95a8003af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.074029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-764daf2a-17fe-4089-a9e7-91c95a8003af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.074029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-764daf2a-17fe-4089-a9e7-91c95a8003af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.074029] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('764daf2a-17fe-4089-a9e7-91c95a8003af',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.254816] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94c2c94f-175c-4b4b-b867-704e1305affb [ 611.254816] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.254816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.254816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.255126] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.255266] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.255410] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94c2c94f-175c-4b4b-b867-704e1305affb already deleted. [ 611.255537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94c2c94f-175c-4b4b-b867-704e1305affb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.293066] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.293260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.293302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.293502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.293595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.293832] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.293928] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.293998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.294183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.294265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.294347] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 already deleted. [ 611.294476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.370485] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.370688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.370764] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.370986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.371090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.371216] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dea2a277-9a95-4e9e-8fe7-677b4d405cd4 already deleted. [ 611.371307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dea2a277-9a95-4e9e-8fe7-677b4d405cd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.579413] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 764daf2a-17fe-4089-a9e7-91c95a8003af [ 611.579667] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.579848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.579926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.580203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.580252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.580353] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:764daf2a-17fe-4089-a9e7-91c95a8003af already deleted. [ 611.580438] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-764daf2a-17fe-4089-a9e7-91c95a8003af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.814634] env[69360]: INFO networking_nsxv3.common.synchronization [None req-d8d20ad3-9716-4e20-98ec-d3818bcb2b04 tempest-ServersWithSpecificFlavorTestJSON-1357925327 tempest-ServersWithSpecificFlavorTestJSON-1357925327-project-member] Enqueued Resource ID: d868ea9d-5d7c-4b77-a067-725e79576a3c with Priority: HIGHEST for action security_group_rules [ 611.814634] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d868ea9d-5d7c-4b77-a067-725e79576a3c with Priority: HIGHEST for action security_group_rules [ 611.817034] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d868ea9d-5d7c-4b77-a067-725e79576a3c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.817034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.817034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.817034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.817034] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d868ea9d-5d7c-4b77-a067-725e79576a3c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.946541] env[69360]: INFO networking_nsxv3.common.synchronization [None req-4bcb8589-3c76-4d51-91ec-f7cd61da970f None None] Enqueued Resource ID: 28b96fbb-907c-4f9a-b568-646213fddcf5 with Priority: HIGHEST for action port [ 611.947470] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28b96fbb-907c-4f9a-b568-646213fddcf5 with Priority: HIGHEST for action port [ 611.947558] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-28b96fbb-907c-4f9a-b568-646213fddcf5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.947680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28b96fbb-907c-4f9a-b568-646213fddcf5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.947748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28b96fbb-907c-4f9a-b568-646213fddcf5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.949128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28b96fbb-907c-4f9a-b568-646213fddcf5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.949295] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28b96fbb-907c-4f9a-b568-646213fddcf5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.125654] env[69360]: INFO networking_nsxv3.common.synchronization [None req-bbfdcada-3e06-4163-a0ae-21022fb12fb3 tempest-ServersWithSpecificFlavorTestJSON-1357925327 tempest-ServersWithSpecificFlavorTestJSON-1357925327-project-member] Enqueued Resource ID: d868ea9d-5d7c-4b77-a067-725e79576a3c with Priority: HIGHEST for action security_group_rules [ 612.128643] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d868ea9d-5d7c-4b77-a067-725e79576a3c with Priority: HIGHEST for action security_group_rules [ 612.132143] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d868ea9d-5d7c-4b77-a067-725e79576a3c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.132143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.299408] env[69360]: INFO networking_nsxv3.common.synchronization [req-3e0be0f0-b551-4bea-8ef9-7c8940c10892 req-7fb68c5c-04eb-4dbd-a625-95a849662f0a tempest-DeleteServersAdminTestJSON-480487764 tempest-DeleteServersAdminTestJSON-480487764-project-member] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 612.299548] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 612.300975] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.300975] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.300975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.301279] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.340201] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.340888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.340888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.340888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.341182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.341373] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d868ea9d-5d7c-4b77-a067-725e79576a3c already deleted. [ 612.341514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.342151] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.343094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.343436] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d868ea9d-5d7c-4b77-a067-725e79576a3c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.454703] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28b96fbb-907c-4f9a-b568-646213fddcf5 [ 612.454703] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.454703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.454703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.454703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.454703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.454703] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28b96fbb-907c-4f9a-b568-646213fddcf5 already deleted. [ 612.454960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28b96fbb-907c-4f9a-b568-646213fddcf5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.805116] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.805285] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.805475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.805601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.805693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.805917] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.805917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.805917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.806239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.806286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.806339] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0fbef34-d753-4a4a-92ea-55434312119d already deleted. [ 612.806415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.866256] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.866256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.866256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.866256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.867556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.867556] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d868ea9d-5d7c-4b77-a067-725e79576a3c already deleted. [ 612.867556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d868ea9d-5d7c-4b77-a067-725e79576a3c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.141085] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3bca7da0-41ac-4b3a-940c-8263bbcdc6e0 None None] Enqueued Resource ID: 2b6a4625-a074-4c6b-9237-5c28560dec18 with Priority: HIGHEST for action port [ 613.141771] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6a4625-a074-4c6b-9237-5c28560dec18 with Priority: HIGHEST for action port [ 613.141977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b6a4625-a074-4c6b-9237-5c28560dec18 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.142215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b6a4625-a074-4c6b-9237-5c28560dec18" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.142215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b6a4625-a074-4c6b-9237-5c28560dec18" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.142722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b6a4625-a074-4c6b-9237-5c28560dec18" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.142722] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6a4625-a074-4c6b-9237-5c28560dec18',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.448395] env[69360]: INFO networking_nsxv3.common.synchronization [None req-69168106-74f0-4915-af73-0f565c16bc83 None None] Enqueued Resource ID: 53bf5630-90f4-4049-976f-d5bdc5541051 with Priority: HIGHEST for action port [ 613.449675] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bf5630-90f4-4049-976f-d5bdc5541051 with Priority: HIGHEST for action port [ 613.451818] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-53bf5630-90f4-4049-976f-d5bdc5541051 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.451818] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53bf5630-90f4-4049-976f-d5bdc5541051" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.451818] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53bf5630-90f4-4049-976f-d5bdc5541051" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.452024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53bf5630-90f4-4049-976f-d5bdc5541051" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.452368] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53bf5630-90f4-4049-976f-d5bdc5541051',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.648776] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b6a4625-a074-4c6b-9237-5c28560dec18 [ 613.648776] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.648776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.648776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.648776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.648776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.648776] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b6a4625-a074-4c6b-9237-5c28560dec18 already deleted. [ 613.648776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b6a4625-a074-4c6b-9237-5c28560dec18" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.716684] env[69360]: INFO networking_nsxv3.common.synchronization [None req-257b6bcb-a52b-4ef1-a6e9-663e02e189bc None None] Enqueued Resource ID: 8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7 with Priority: HIGHEST for action port [ 613.717446] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7 with Priority: HIGHEST for action port [ 613.723212] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.723212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.723212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.723212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.723212] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.957761] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53bf5630-90f4-4049-976f-d5bdc5541051 [ 613.958090] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.958178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.958228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.958476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.958561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.958669] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53bf5630-90f4-4049-976f-d5bdc5541051 already deleted. [ 613.958742] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53bf5630-90f4-4049-976f-d5bdc5541051" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.227411] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7 [ 614.228310] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.228310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.228310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.228310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.228310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.228310] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7 already deleted. [ 614.228658] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c5a4381-5c26-4b2d-a3a3-3d4fea68f5b7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.809374] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.809580] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.809711] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.811175] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.815227] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.815227] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.815227] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.815227] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.815227] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.815227] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.815227] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.815227] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.815227] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.815227] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.815227] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.815227] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.840495] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.840891] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 614.842138] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.842138] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.842138] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-4051893d-10cc-4cb9-8e30-089e8d3d4286 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.842138] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.842615] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.848250] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.848250] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4051893d-10cc-4cb9-8e30-089e8d3d4286',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.041747] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.042153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.042153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.042646] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.042883] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.042883] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.043177] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.043233] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.043811] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.043811] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.043811] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.043811] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.043975] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.043975] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 615.045389] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.045467] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.064425] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.066374] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 615.066374] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.066374] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.066374] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-c1cd0433-e331-4e76-af42-c5cd0421b041 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.066374] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.066374] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.066374] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.066374] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cd0433-e331-4e76-af42-c5cd0421b041',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.350175] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.350551] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.350551] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.350832] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.350986] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.351176] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 4051893d-10cc-4cb9-8e30-089e8d3d4286 not found, creating... [ 615.352077] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.352077] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.352077] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.352077] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.352320] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.352619] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.353306] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.353306] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.353306] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.356693] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.356880] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 4051893d-10cc-4cb9-8e30-089e8d3d4286 is going to be created. [ 615.381658] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.382135] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.386436] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.386436] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.387019] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.387019] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.570505] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.570724] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.570854] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.571235] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.571383] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.571541] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port c1cd0433-e331-4e76-af42-c5cd0421b041 not found, creating... [ 615.571849] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.572037] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.572158] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.572818] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.572818] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.572818] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.572983] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.573332] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.573685] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.573886] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.574077] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: c1cd0433-e331-4e76-af42-c5cd0421b041 is going to be created. [ 615.596564] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.596904] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.596973] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.597351] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.597554] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.597821] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.675507] env[69360]: INFO networking_nsxv3.common.synchronization [req-3e0be0f0-b551-4bea-8ef9-7c8940c10892 req-95cda37f-15f0-4b59-81ee-57a775a29b21 service nova] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_rules [ 616.675777] env[69360]: INFO networking_nsxv3.common.synchronization [req-3e0be0f0-b551-4bea-8ef9-7c8940c10892 req-95cda37f-15f0-4b59-81ee-57a775a29b21 service nova] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 616.675777] env[69360]: INFO networking_nsxv3.common.synchronization [req-3e0be0f0-b551-4bea-8ef9-7c8940c10892 req-95cda37f-15f0-4b59-81ee-57a775a29b21 service nova] Enqueued Resource ID: 4051893d-10cc-4cb9-8e30-089e8d3d4286 with Priority: HIGHEST for action port [ 616.676375] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_rules [ 616.676542] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 616.676639] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4051893d-10cc-4cb9-8e30-089e8d3d4286 with Priority: HIGHEST for action port [ 616.676910] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.677146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.677213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.677474] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.677557] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.679533] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.679533] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.679533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.679533] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.680931] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4051893d-10cc-4cb9-8e30-089e8d3d4286 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.680931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.680931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.681262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.681262] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4051893d-10cc-4cb9-8e30-089e8d3d4286',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.757036] env[69360]: INFO networking_nsxv3.common.synchronization [req-e5c55306-db19-47a1-ba30-976ca079999c req-819c3dae-aa9c-497e-89be-3133540d6f84 service nova] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_rules [ 616.757036] env[69360]: INFO networking_nsxv3.common.synchronization [req-e5c55306-db19-47a1-ba30-976ca079999c req-819c3dae-aa9c-497e-89be-3133540d6f84 service nova] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 616.757036] env[69360]: INFO networking_nsxv3.common.synchronization [req-e5c55306-db19-47a1-ba30-976ca079999c req-819c3dae-aa9c-497e-89be-3133540d6f84 service nova] Enqueued Resource ID: c1cd0433-e331-4e76-af42-c5cd0421b041 with Priority: HIGHEST for action port [ 616.757036] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_rules [ 616.757036] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 616.757281] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c1cd0433-e331-4e76-af42-c5cd0421b041 with Priority: HIGHEST for action port [ 616.757752] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.758275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.758275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.758275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.758426] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.759489] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.759617] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.759697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.759924] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.760107] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.760188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.760253] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.760399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.760485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.763598] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.763598] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c1cd0433-e331-4e76-af42-c5cd0421b041 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.763598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.765064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.765339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.765441] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c1cd0433-e331-4e76-af42-c5cd0421b041',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.905643] env[69360]: INFO networking_nsxv3.common.synchronization [None req-25f26e40-25a5-4a40-a80c-909cdbab9aa5 None None] Enqueued Resource ID: 9ecc38fe-9274-495e-9f05-8f446d9c90c2 with Priority: HIGHEST for action port [ 616.906112] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ecc38fe-9274-495e-9f05-8f446d9c90c2 with Priority: HIGHEST for action port [ 616.906485] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ecc38fe-9274-495e-9f05-8f446d9c90c2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.906603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ecc38fe-9274-495e-9f05-8f446d9c90c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.906670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ecc38fe-9274-495e-9f05-8f446d9c90c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.907045] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ecc38fe-9274-495e-9f05-8f446d9c90c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.907147] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ecc38fe-9274-495e-9f05-8f446d9c90c2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.184554] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.184554] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.190315] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4051893d-10cc-4cb9-8e30-089e8d3d4286 with status ACTIVE [ 617.190729] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.190729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.190962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.190962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.191075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.191327] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.191434] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.192074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.192171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.192281] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.192481] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.192615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.192665] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.193095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.193095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.193220] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4051893d-10cc-4cb9-8e30-089e8d3d4286 is going to be updated. [ 617.195486] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.220189] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.220436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.220436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.221191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.221191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.221191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4051893d-10cc-4cb9-8e30-089e8d3d4286" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.262235] env[69360]: INFO networking_nsxv3.common.synchronization [None req-aa6d12ad-c450-42ce-a8d2-76e34a68ad37 None None] Enqueued Resource ID: f0425f0d-bbea-429e-ace7-bb457b70154b with Priority: HIGHEST for action port [ 617.262235] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0425f0d-bbea-429e-ace7-bb457b70154b with Priority: HIGHEST for action port [ 617.262235] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0425f0d-bbea-429e-ace7-bb457b70154b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.262755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0425f0d-bbea-429e-ace7-bb457b70154b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.262755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0425f0d-bbea-429e-ace7-bb457b70154b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.263089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0425f0d-bbea-429e-ace7-bb457b70154b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.263203] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0425f0d-bbea-429e-ace7-bb457b70154b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.267236] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.271158] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.271158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.271158] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c1cd0433-e331-4e76-af42-c5cd0421b041 with status ACTIVE [ 617.271158] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.271158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.271158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.271158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.271158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.272125] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.272125] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.272125] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.273184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.273184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.273184] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.273184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.273184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.273184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.273496] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.274831] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c1cd0433-e331-4e76-af42-c5cd0421b041 is going to be updated. [ 617.315046] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.315484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.315484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.315676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.315988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.316103] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c1cd0433-e331-4e76-af42-c5cd0421b041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.411302] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ecc38fe-9274-495e-9f05-8f446d9c90c2 [ 617.411302] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.411596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.411596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.412839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.412956] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.413247] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ecc38fe-9274-495e-9f05-8f446d9c90c2 already deleted. [ 617.413247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ecc38fe-9274-495e-9f05-8f446d9c90c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.700985] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.768097] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f0425f0d-bbea-429e-ace7-bb457b70154b [ 617.768375] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.769582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.769582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.769582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.769582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.769582] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f0425f0d-bbea-429e-ace7-bb457b70154b already deleted. [ 617.769582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0425f0d-bbea-429e-ace7-bb457b70154b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.771292] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.206533] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.206824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.206888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.207117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.207230] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.207335] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0fbef34-d753-4a4a-92ea-55434312119d is going to be created. [ 618.238123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.238288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.238364] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.238585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.238758] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.250991] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: UNINITIALIZED for 2s [ 618.273719] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.273884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.273959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.275559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.275559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.275559] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 is going to be created. [ 618.301903] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.301903] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.302793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.302793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.302793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.315982] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: UNINITIALIZED for 2s [ 618.326450] env[69360]: INFO networking_nsxv3.common.synchronization [None req-dd4b55a9-077c-47da-8910-81f2725020b1 None None] Enqueued Resource ID: 524a7f9a-a58a-4dce-a846-1068d7ed6a1f with Priority: HIGHEST for action port [ 618.327026] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 524a7f9a-a58a-4dce-a846-1068d7ed6a1f with Priority: HIGHEST for action port [ 618.327297] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-524a7f9a-a58a-4dce-a846-1068d7ed6a1f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.327427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-524a7f9a-a58a-4dce-a846-1068d7ed6a1f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.327492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-524a7f9a-a58a-4dce-a846-1068d7ed6a1f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.327751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-524a7f9a-a58a-4dce-a846-1068d7ed6a1f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.327840] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('524a7f9a-a58a-4dce-a846-1068d7ed6a1f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.835094] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 524a7f9a-a58a-4dce-a846-1068d7ed6a1f [ 618.835094] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.835094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.835094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.835094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.835512] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.835512] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:524a7f9a-a58a-4dce-a846-1068d7ed6a1f already deleted. [ 618.835512] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-524a7f9a-a58a-4dce-a846-1068d7ed6a1f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.584950] env[69360]: INFO networking_nsxv3.common.synchronization [req-bc7c8f34-4eb1-4127-ba79-caae84f4836e req-e38b1aa2-609e-4514-9cf2-c61369526f3b tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 619.585567] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 619.585880] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.586024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.586105] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.586342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.586621] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.586621] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.586752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.586820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.586893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.586984] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.090585] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.090931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.090931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.092110] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.092110] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab already deleted. [ 620.092110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.263496] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: SUCCESS [ 620.263724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.263969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.264146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.264336] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.264464] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.264525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.264694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.264771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.264872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.264982] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.326291] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: SUCCESS [ 620.326599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.326716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.326960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.327130] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.327268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.327329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.327512] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.327598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.327687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.327776] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.768863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.768863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.768863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.769733] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.769733] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.769733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.770226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.770226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.770226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.770226] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.832011] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.832202] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.832263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.835273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.835567] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.835734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.835825] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.836137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.836183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.836312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.836529] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.836652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.836737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.837061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.837235] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.837306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.837409] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.837605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.837702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.837896] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.837951] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.275089] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0fbef34-d753-4a4a-92ea-55434312119d: rpc.has_security_group_logging(os_id): False [ 621.298487] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.298661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.298798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.298961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.299071] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.299326] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.299462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.299517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.299689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.299800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.299989] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.300131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.300165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.300397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.300397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.300551] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.300638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.300705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.300847] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.300923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.301018] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0fbef34-d753-4a4a-92ea-55434312119d is going to be created. [ 621.343638] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d4f9a399-698a-42da-8c89-814b7c1e7204: rpc.has_security_group_logging(os_id): False [ 621.379099] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.379391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.379489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.379757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.380030] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.387776] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.387890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.387890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.388256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.388366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.388580] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.388696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.388767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.389487] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.389487] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.389487] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.389487] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.389487] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.389887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.389887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.389972] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.391166] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.391166] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.391166] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.391320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.391320] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 is going to be created. [ 621.393681] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: IN_PROGRESS for 2s [ 621.498310] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.498494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.498534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.498788] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.499053] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.516369] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: IN_PROGRESS for 2s [ 621.803169] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.803410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.803638] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.803924] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.804855] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.805076] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.805231] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.806203] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.806403] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.806627] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.806747] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.806863] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.807048] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.807169] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 621.807205] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.807337] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.832598] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.832769] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 621.833020] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.833381] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.833584] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-013efad5-0b57-43e9-b662-10e31d24d8af taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.833756] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.833874] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.834223] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.834757] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013efad5-0b57-43e9-b662-10e31d24d8af',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.861621] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a7bf2217-25a9-47aa-93f0-4399c2265828 None None] Enqueued Resource ID: 32f38bb9-5be6-4230-a105-2392865fc957 with Priority: HIGHEST for action port [ 621.865499] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32f38bb9-5be6-4230-a105-2392865fc957 with Priority: HIGHEST for action port [ 621.866865] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-32f38bb9-5be6-4230-a105-2392865fc957 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.866865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32f38bb9-5be6-4230-a105-2392865fc957" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.866865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32f38bb9-5be6-4230-a105-2392865fc957" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.866976] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32f38bb9-5be6-4230-a105-2392865fc957" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.867076] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32f38bb9-5be6-4230-a105-2392865fc957',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.337906] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.338274] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.338409] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.339827] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.340135] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.340367] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 013efad5-0b57-43e9-b662-10e31d24d8af not found, creating... [ 622.340711] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.340937] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.341222] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.341530] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.341718] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.342097] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.342841] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.342841] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.342841] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.342841] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.343134] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 013efad5-0b57-43e9-b662-10e31d24d8af is going to be created. [ 622.371327] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.371536] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.374020] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.374020] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.374020] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.374020] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.377599] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32f38bb9-5be6-4230-a105-2392865fc957 [ 622.377983] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.378188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.378256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.378474] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.378560] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.378667] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32f38bb9-5be6-4230-a105-2392865fc957 already deleted. [ 622.378749] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32f38bb9-5be6-4230-a105-2392865fc957" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.465860] env[69360]: INFO networking_nsxv3.common.synchronization [req-54948762-f0b7-4641-9578-c30f1e749672 req-80628889-0ac4-48fa-b5ec-a547407e7274 tempest-ServersTestManualDisk-924480253 tempest-ServersTestManualDisk-924480253-project-member] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 622.466812] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 622.471077] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.471077] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.471077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.471077] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.978156] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.978156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.978156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.978156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.978156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.978414] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.978558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.978630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.978812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.978890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.978996] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f already deleted. [ 622.979088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.109691] env[69360]: INFO networking_nsxv3.common.synchronization [None req-37f7d65c-9c8a-42a6-b7df-44d4ef726827 None None] Enqueued Resource ID: 8a907a50-1ab1-44fa-a5d9-060a1a0ab834 with Priority: HIGHEST for action port [ 623.109691] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a907a50-1ab1-44fa-a5d9-060a1a0ab834 with Priority: HIGHEST for action port [ 623.110680] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a907a50-1ab1-44fa-a5d9-060a1a0ab834 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.113326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a907a50-1ab1-44fa-a5d9-060a1a0ab834" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.113326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a907a50-1ab1-44fa-a5d9-060a1a0ab834" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.113326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a907a50-1ab1-44fa-a5d9-060a1a0ab834" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.113326] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a907a50-1ab1-44fa-a5d9-060a1a0ab834',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.408626] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: SUCCESS [ 623.408626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.531478] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: SUCCESS [ 623.531478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.614240] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a907a50-1ab1-44fa-a5d9-060a1a0ab834 [ 623.614301] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.616943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.616943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.616943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.616943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.616943] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a907a50-1ab1-44fa-a5d9-060a1a0ab834 already deleted. [ 623.616943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a907a50-1ab1-44fa-a5d9-060a1a0ab834" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.195897] env[69360]: INFO networking_nsxv3.common.synchronization [None req-d8187d1b-1051-42ce-b67d-097feee85e84 None None] Enqueued Resource ID: 5e14136a-f116-4332-b256-5e4aaaba7392 with Priority: HIGHEST for action port [ 624.196408] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e14136a-f116-4332-b256-5e4aaaba7392 with Priority: HIGHEST for action port [ 624.199239] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e14136a-f116-4332-b256-5e4aaaba7392 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.199239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e14136a-f116-4332-b256-5e4aaaba7392" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.199239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e14136a-f116-4332-b256-5e4aaaba7392" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.199239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e14136a-f116-4332-b256-5e4aaaba7392" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.199239] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e14136a-f116-4332-b256-5e4aaaba7392',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.217204] env[69360]: INFO networking_nsxv3.common.synchronization [None req-352877ca-74e0-42fd-b504-ad14a4de63bf None None] Enqueued Resource ID: b2c23e26-5811-4553-aa20-90b38bcb8997 with Priority: HIGHEST for action port [ 624.219505] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2c23e26-5811-4553-aa20-90b38bcb8997 with Priority: HIGHEST for action port [ 624.219628] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2c23e26-5811-4553-aa20-90b38bcb8997 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.219933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2c23e26-5811-4553-aa20-90b38bcb8997" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.220432] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2c23e26-5811-4553-aa20-90b38bcb8997" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.221197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2c23e26-5811-4553-aa20-90b38bcb8997" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.221197] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2c23e26-5811-4553-aa20-90b38bcb8997',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.454022] env[69360]: INFO networking_nsxv3.common.synchronization [req-5854b3bc-c81a-4206-8ac8-88051bb306a9 req-1677d17b-ee90-4ce8-a991-51aac52a03f0 tempest-ImagesNegativeTestJSON-1017324503 tempest-ImagesNegativeTestJSON-1017324503-project-member] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 624.454022] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 624.454022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.454022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.454022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.454913] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.699971] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e14136a-f116-4332-b256-5e4aaaba7392 [ 624.699971] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.699971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.699971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.700200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.700200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.700803] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e14136a-f116-4332-b256-5e4aaaba7392 already deleted. [ 624.700803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e14136a-f116-4332-b256-5e4aaaba7392" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.727260] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2c23e26-5811-4553-aa20-90b38bcb8997 [ 624.727260] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.727260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.727260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.727260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.727260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.727260] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2c23e26-5811-4553-aa20-90b38bcb8997 already deleted. [ 624.727260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2c23e26-5811-4553-aa20-90b38bcb8997" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.792267] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.793154] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-209" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.793376] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-209" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.794292] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-209" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.794292] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.794292] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.794641] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.794641] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.794799] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.795089] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.795231] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.795422] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.795535] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.795608] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 624.795665] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.795808] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.832930] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.837060] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 624.837060] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.837060] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-209" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.837060] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.837060] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.837060] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.837060] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.837060] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a0688d-a5a2-4937-9ac7-25b53f9b001d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [req-bc7c8f34-4eb1-4127-ba79-caae84f4836e req-f075f5fd-9a22-4147-a402-7385a02e1e7c service nova] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [req-bc7c8f34-4eb1-4127-ba79-caae84f4836e req-f075f5fd-9a22-4147-a402-7385a02e1e7c service nova] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [req-bc7c8f34-4eb1-4127-ba79-caae84f4836e req-f075f5fd-9a22-4147-a402-7385a02e1e7c service nova] Enqueued Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 624.847300] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 624.847300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.847300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.847300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.851132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.851355] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.854244] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.854244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.854244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.854244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.855356] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.855356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.855356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.855356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.855356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.855356] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.856652] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-013efad5-0b57-43e9-b662-10e31d24d8af taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.857095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.857290] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013efad5-0b57-43e9-b662-10e31d24d8af',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.957503] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.960226] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.960226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.963122] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 already deleted. [ 624.963122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.347872] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.348196] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.348389] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.353881] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port b6a0688d-a5a2-4937-9ac7-25b53f9b001d not found, creating... [ 625.353881] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.353881] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.353881] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.354992] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.354992] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.354992] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.354992] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: b6a0688d-a5a2-4937-9ac7-25b53f9b001d is going to be created. [ 625.364876] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.364876] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.364876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.364876] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013efad5-0b57-43e9-b662-10e31d24d8af with status ACTIVE [ 625.364876] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.364876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.364876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.364876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.364876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.364876] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.365911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.365911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.365911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.365911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.365911] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.366216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.366216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.366216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.366383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.367590] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013efad5-0b57-43e9-b662-10e31d24d8af is going to be updated. [ 625.381042] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.381042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.381042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.381042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.381308] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.381664] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.395926] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.396217] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.396521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.396521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.396705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.396891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.488735] env[69360]: INFO networking_nsxv3.common.synchronization [None req-4a8514d0-6569-46dc-9624-36b012621588 None None] Enqueued Resource ID: 893e5c2b-7a16-4db6-a486-7a4637644292 with Priority: HIGHEST for action port [ 625.493619] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 893e5c2b-7a16-4db6-a486-7a4637644292 with Priority: HIGHEST for action port [ 625.493974] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-893e5c2b-7a16-4db6-a486-7a4637644292 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.494136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-893e5c2b-7a16-4db6-a486-7a4637644292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.494211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-893e5c2b-7a16-4db6-a486-7a4637644292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.495559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-893e5c2b-7a16-4db6-a486-7a4637644292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.495559] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('893e5c2b-7a16-4db6-a486-7a4637644292',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.677972] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3f3638e7-a7b3-4155-940c-4e2ba2328817 tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 625.678933] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 625.679351] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.679483] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.679558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.681574] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.681715] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.870885] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.998399] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 893e5c2b-7a16-4db6-a486-7a4637644292 [ 625.998843] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.999786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.000692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.000692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.000692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.000692] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:893e5c2b-7a16-4db6-a486-7a4637644292 already deleted. [ 626.000692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-893e5c2b-7a16-4db6-a486-7a4637644292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.210016] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.210016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.210016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.210016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.210016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.210016] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 already deleted. [ 626.210016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.269708] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a907190c-cf6c-4aa2-a63d-ec886bb04fce tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 626.270428] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 626.270749] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.270877] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.271008] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.271205] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.271296] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.374108] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.374108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.374108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.374350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.374350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.374350] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be created. [ 626.405862] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.405862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.405862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.405862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.405862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.416276] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: UNINITIALIZED for 2s [ 626.640937] env[69360]: INFO networking_nsxv3.common.synchronization [None req-c272ba27-eb3b-4bd3-b48f-e6da6c29bf2f None None] Enqueued Resource ID: d26ee6cf-27bc-42a6-9160-cc0137965dd4 with Priority: HIGHEST for action port [ 626.641505] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26ee6cf-27bc-42a6-9160-cc0137965dd4 with Priority: HIGHEST for action port [ 626.642012] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26ee6cf-27bc-42a6-9160-cc0137965dd4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.642012] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26ee6cf-27bc-42a6-9160-cc0137965dd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.642012] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26ee6cf-27bc-42a6-9160-cc0137965dd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.642682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26ee6cf-27bc-42a6-9160-cc0137965dd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.642770] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26ee6cf-27bc-42a6-9160-cc0137965dd4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.785095] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.785347] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-71" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.785477] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-71" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.785916] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-71" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.786230] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786744] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786934] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.787209] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.787368] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.787579] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.787691] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.787800] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.787907] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.788249] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 626.788249] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.788249] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.797225] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.797338] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.797406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.797617] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.797703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.797796] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 already deleted. [ 626.797870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.809428] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.809627] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 626.809784] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.810030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-71" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.810354] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-a7fe18e3-9f20-481e-b223-1b2907709041 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.810528] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.810646] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.810955] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.811418] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fe18e3-9f20-481e-b223-1b2907709041',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.147073] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d26ee6cf-27bc-42a6-9160-cc0137965dd4 [ 627.147073] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.147073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.147073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.147073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.147073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.147073] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d26ee6cf-27bc-42a6-9160-cc0137965dd4 already deleted. [ 627.147073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26ee6cf-27bc-42a6-9160-cc0137965dd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.309532] env[69360]: INFO networking_nsxv3.common.synchronization [None req-031b1990-990f-405b-b60b-ae6adc7abab8 None None] Enqueued Resource ID: 7887d822-f9d5-4df2-b031-e8d1fa47de40 with Priority: HIGHEST for action port [ 627.309532] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7887d822-f9d5-4df2-b031-e8d1fa47de40 with Priority: HIGHEST for action port [ 627.309532] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7887d822-f9d5-4df2-b031-e8d1fa47de40 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.309743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7887d822-f9d5-4df2-b031-e8d1fa47de40" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.309936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7887d822-f9d5-4df2-b031-e8d1fa47de40" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.313561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7887d822-f9d5-4df2-b031-e8d1fa47de40" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.313561] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7887d822-f9d5-4df2-b031-e8d1fa47de40',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.318238] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.318238] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port a7fe18e3-9f20-481e-b223-1b2907709041 not found, creating... [ 627.318238] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.318238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.318685] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.318685] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.318685] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.318685] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.319199] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.319557] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: a7fe18e3-9f20-481e-b223-1b2907709041 is going to be created. [ 627.347572] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.349297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.349297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.349297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.349297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.349297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.807170] env[69360]: INFO networking_nsxv3.common.synchronization [None req-69c32631-cb4c-42cd-8da3-d2e165bc00f5 None None] Enqueued Resource ID: 6320b0fb-3869-40e6-9062-fbef306e085d with Priority: HIGHEST for action port [ 627.807170] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6320b0fb-3869-40e6-9062-fbef306e085d with Priority: HIGHEST for action port [ 627.807170] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-6320b0fb-3869-40e6-9062-fbef306e085d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.807170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6320b0fb-3869-40e6-9062-fbef306e085d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.807170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6320b0fb-3869-40e6-9062-fbef306e085d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.809383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6320b0fb-3869-40e6-9062-fbef306e085d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.809383] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6320b0fb-3869-40e6-9062-fbef306e085d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.815418] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7887d822-f9d5-4df2-b031-e8d1fa47de40 [ 627.818046] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.818207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.818751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.818751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.818751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.818751] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7887d822-f9d5-4df2-b031-e8d1fa47de40 already deleted. [ 627.818751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7887d822-f9d5-4df2-b031-e8d1fa47de40" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.995789] env[69360]: INFO networking_nsxv3.common.synchronization [req-54948762-f0b7-4641-9578-c30f1e749672 req-3e0648f8-51b5-4ffa-8ffd-b79f792ed2b5 service nova] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 627.995789] env[69360]: INFO networking_nsxv3.common.synchronization [req-54948762-f0b7-4641-9578-c30f1e749672 req-3e0648f8-51b5-4ffa-8ffd-b79f792ed2b5 service nova] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 627.995789] env[69360]: INFO networking_nsxv3.common.synchronization [req-54948762-f0b7-4641-9578-c30f1e749672 req-3e0648f8-51b5-4ffa-8ffd-b79f792ed2b5 service nova] Enqueued Resource ID: b6a0688d-a5a2-4937-9ac7-25b53f9b001d with Priority: HIGHEST for action port [ 627.995789] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_rules [ 627.995789] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 627.999446] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6a0688d-a5a2-4937-9ac7-25b53f9b001d with Priority: HIGHEST for action port [ 627.999446] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.999446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.999446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.999446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.999446] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.999446] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.999446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.000660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.001484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.002106] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.002740] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.003136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.003732] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.004242] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.004735] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.009598] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.009598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.009598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.009598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.009598] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6a0688d-a5a2-4937-9ac7-25b53f9b001d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.311200] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6320b0fb-3869-40e6-9062-fbef306e085d [ 628.311463] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.311752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.311752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.311975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.312061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.312178] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6320b0fb-3869-40e6-9062-fbef306e085d already deleted. [ 628.312277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6320b0fb-3869-40e6-9062-fbef306e085d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.427212] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 628.427324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.427493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.427767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.427929] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.428840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.428840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.429128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.429128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.429128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.429226] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.512218] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.512218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.512218] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6a0688d-a5a2-4937-9ac7-25b53f9b001d with status ACTIVE [ 628.512218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.512218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.512218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.513412] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.514034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.514306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.514627] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.514861] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.516029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.516029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.516029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.516029] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6a0688d-a5a2-4937-9ac7-25b53f9b001d is going to be updated. [ 628.540432] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.540512] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.540603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.541273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.541273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.541273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6a0688d-a5a2-4937-9ac7-25b53f9b001d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.932707] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.933313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.933313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.933313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.933927] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.933927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.933927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.933927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.934419] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.934419] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.934419] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.934693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.934693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.934763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.934890] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.934984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.935055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.935197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.935593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.936397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.936545] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.018809] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.070103] env[69360]: INFO networking_nsxv3.common.synchronization [req-5854b3bc-c81a-4206-8ac8-88051bb306a9 req-49ea3b98-8670-4c6e-8417-a097dfb3cc2d service nova] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_rules [ 629.070292] env[69360]: INFO networking_nsxv3.common.synchronization [req-5854b3bc-c81a-4206-8ac8-88051bb306a9 req-49ea3b98-8670-4c6e-8417-a097dfb3cc2d service nova] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 629.070441] env[69360]: INFO networking_nsxv3.common.synchronization [req-5854b3bc-c81a-4206-8ac8-88051bb306a9 req-49ea3b98-8670-4c6e-8417-a097dfb3cc2d service nova] Enqueued Resource ID: a7fe18e3-9f20-481e-b223-1b2907709041 with Priority: HIGHEST for action port [ 629.070974] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_rules [ 629.071126] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 629.071224] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fe18e3-9f20-481e-b223-1b2907709041 with Priority: HIGHEST for action port [ 629.071493] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.071616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.071683] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.072484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.072597] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.073803] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.073803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.073803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.073963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.074663] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.074663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.074663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.074663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.074663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.074663] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.075742] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7fe18e3-9f20-481e-b223-1b2907709041 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.079157] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.079252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.079473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.079550] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fe18e3-9f20-481e-b223-1b2907709041',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.439865] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 629.469872] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.470091] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.470134] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.470348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.470440] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.470833] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.470833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.470833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.471032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.471032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.471484] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.471484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.471484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.471631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.471631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.472481] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.472730] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.472881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.473105] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.473233] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.473356] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be created. [ 629.525856] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.525856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.525856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.525856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.525856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.525856] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f is going to be created. [ 629.564673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.564827] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.564921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.565257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.565332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.577603] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: UNINITIALIZED for 2s [ 629.581167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.581395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.581721] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.582609] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7fe18e3-9f20-481e-b223-1b2907709041 with status ACTIVE [ 629.582704] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.583063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.583063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.583179] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.583244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.583442] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.583531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.583731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.583731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.583932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.583970] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.584787] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.585385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.585668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.585668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.585921] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7fe18e3-9f20-481e-b223-1b2907709041 is going to be updated. [ 629.592578] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.592808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.592808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.593152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.593236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.612616] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 629.619976] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.620358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.620358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.620948] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.620948] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.620948] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7fe18e3-9f20-481e-b223-1b2907709041" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.091779] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.595531] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.596302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.596501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.596835] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.597136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.597330] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 is going to be created. [ 630.638491] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.638491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.638491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.638491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.638491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.652031] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: UNINITIALIZED for 2s [ 630.918191] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3013c822-b6a8-44bf-b447-793ecb5cd5d3 None None] Enqueued Resource ID: e849d474-0543-4b48-ad41-6de14b9ba9d1 with Priority: HIGHEST for action port [ 630.918191] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e849d474-0543-4b48-ad41-6de14b9ba9d1 with Priority: HIGHEST for action port [ 630.918191] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e849d474-0543-4b48-ad41-6de14b9ba9d1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.918191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e849d474-0543-4b48-ad41-6de14b9ba9d1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.918191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e849d474-0543-4b48-ad41-6de14b9ba9d1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.918191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e849d474-0543-4b48-ad41-6de14b9ba9d1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.918544] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e849d474-0543-4b48-ad41-6de14b9ba9d1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.204752] env[69360]: INFO networking_nsxv3.common.synchronization [None req-899649ff-cf4c-461d-99e1-01c94b166c2c None None] Enqueued Resource ID: 0a84ca8b-4755-45ed-b7a5-659012ace4e6 with Priority: HIGHEST for action port [ 631.205466] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a84ca8b-4755-45ed-b7a5-659012ace4e6 with Priority: HIGHEST for action port [ 631.208158] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a84ca8b-4755-45ed-b7a5-659012ace4e6 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.208158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a84ca8b-4755-45ed-b7a5-659012ace4e6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.208158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a84ca8b-4755-45ed-b7a5-659012ace4e6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.208158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a84ca8b-4755-45ed-b7a5-659012ace4e6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.208158] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a84ca8b-4755-45ed-b7a5-659012ace4e6',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.306326] env[69360]: INFO networking_nsxv3.common.synchronization [None req-984a56e0-f2af-469c-b01b-cd6c95317cba None None] Enqueued Resource ID: c4cf12e7-2ced-40fd-b67f-cd2f999b4660 with Priority: HIGHEST for action port [ 631.308557] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4cf12e7-2ced-40fd-b67f-cd2f999b4660 with Priority: HIGHEST for action port [ 631.308557] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4cf12e7-2ced-40fd-b67f-cd2f999b4660 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.308557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4cf12e7-2ced-40fd-b67f-cd2f999b4660" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.308557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4cf12e7-2ced-40fd-b67f-cd2f999b4660" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.308939] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4cf12e7-2ced-40fd-b67f-cd2f999b4660" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.308939] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4cf12e7-2ced-40fd-b67f-cd2f999b4660',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.421955] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e849d474-0543-4b48-ad41-6de14b9ba9d1 [ 631.422420] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.422869] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.423691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.423691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.423691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.423691] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e849d474-0543-4b48-ad41-6de14b9ba9d1 already deleted. [ 631.423691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e849d474-0543-4b48-ad41-6de14b9ba9d1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.595132] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: SUCCESS [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.595132] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.595132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.595132] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.625783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 631.626141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.672608] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f7cc0ddd-0cc9-479a-a244-708cd23a49fc None None] Enqueued Resource ID: 2cc7b383-fa71-4472-9163-33ff3a4b4024 with Priority: HIGHEST for action port [ 631.673090] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cc7b383-fa71-4472-9163-33ff3a4b4024 with Priority: HIGHEST for action port [ 631.674307] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cc7b383-fa71-4472-9163-33ff3a4b4024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.674307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cc7b383-fa71-4472-9163-33ff3a4b4024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.674307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cc7b383-fa71-4472-9163-33ff3a4b4024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.674307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cc7b383-fa71-4472-9163-33ff3a4b4024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.674307] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cc7b383-fa71-4472-9163-33ff3a4b4024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.715975] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a84ca8b-4755-45ed-b7a5-659012ace4e6 [ 631.715975] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.715975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.715975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.715975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.715975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.715975] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a84ca8b-4755-45ed-b7a5-659012ace4e6 already deleted. [ 631.715975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a84ca8b-4755-45ed-b7a5-659012ace4e6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.773796] env[69360]: INFO networking_nsxv3.common.synchronization [None req-c638b978-00b8-4a7b-a977-42d21c87000a None None] Enqueued Resource ID: 56fa6386-990e-48b1-9612-ccb63aeaf9ff with Priority: HIGHEST for action port [ 631.773796] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56fa6386-990e-48b1-9612-ccb63aeaf9ff with Priority: HIGHEST for action port [ 631.773796] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-56fa6386-990e-48b1-9612-ccb63aeaf9ff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.773796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56fa6386-990e-48b1-9612-ccb63aeaf9ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.773796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56fa6386-990e-48b1-9612-ccb63aeaf9ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.774312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56fa6386-990e-48b1-9612-ccb63aeaf9ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.774312] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56fa6386-990e-48b1-9612-ccb63aeaf9ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.812581] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4cf12e7-2ced-40fd-b67f-cd2f999b4660 [ 631.812814] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.812975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.813087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.813311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.813435] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.813541] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4cf12e7-2ced-40fd-b67f-cd2f999b4660 already deleted. [ 631.813627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4cf12e7-2ced-40fd-b67f-cd2f999b4660" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.902849] env[69360]: INFO networking_nsxv3.common.synchronization [None req-af07f375-dd05-4df9-bcf1-7a973345cb84 None None] Enqueued Resource ID: 0dbf32bd-d809-4dfd-b47e-5a0f443cbe39 with Priority: HIGHEST for action port [ 631.904352] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dbf32bd-d809-4dfd-b47e-5a0f443cbe39 with Priority: HIGHEST for action port [ 631.904885] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dbf32bd-d809-4dfd-b47e-5a0f443cbe39 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.904885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dbf32bd-d809-4dfd-b47e-5a0f443cbe39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.904885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dbf32bd-d809-4dfd-b47e-5a0f443cbe39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.906018] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dbf32bd-d809-4dfd-b47e-5a0f443cbe39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.906131] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dbf32bd-d809-4dfd-b47e-5a0f443cbe39',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.097904] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.184961] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cc7b383-fa71-4472-9163-33ff3a4b4024 [ 632.184961] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.184961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.184961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.184961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.184961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.185223] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cc7b383-fa71-4472-9163-33ff3a4b4024 already deleted. [ 632.185223] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cc7b383-fa71-4472-9163-33ff3a4b4024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.276917] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56fa6386-990e-48b1-9612-ccb63aeaf9ff [ 632.276917] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.276917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.276917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.277360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.277360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.277360] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56fa6386-990e-48b1-9612-ccb63aeaf9ff already deleted. [ 632.277451] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56fa6386-990e-48b1-9612-ccb63aeaf9ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.410208] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0dbf32bd-d809-4dfd-b47e-5a0f443cbe39 [ 632.410208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.410208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.410208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.410208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.410208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.410208] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0dbf32bd-d809-4dfd-b47e-5a0f443cbe39 already deleted. [ 632.410208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dbf32bd-d809-4dfd-b47e-5a0f443cbe39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.602728] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8e6f228-ab6c-4d13-b101-bef38530e43f: rpc.has_security_group_logging(os_id): False [ 632.638979] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.639224] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.640352] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.640352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.640771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.640771] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f is going to be created. [ 632.667811] env[69360]: INFO networking_nsxv3.common.synchronization [req-7b94712f-24c6-4e7c-bb81-62b66d431601 req-04a93b33-e9e3-4984-964f-1522fbe32311 tempest-DeleteServersAdminTestJSON-676728523 tempest-DeleteServersAdminTestJSON-676728523-project-admin] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 632.669652] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: SUCCESS [ 632.670050] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.670820] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGHEST for action security_group_members [ 632.671177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.671492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.671869] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.672206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.672419] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.672935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.673233] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.673575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.673832] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.675977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.677599] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.677599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.677599] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.717886] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.717886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.717886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.717886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.717886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.732452] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: IN_PROGRESS for 2s [ 633.181672] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.181748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.181812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.182063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.182164] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.182365] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.182610] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.182610] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.182711] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.182809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.182953] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0fbef34-d753-4a4a-92ea-55434312119d is going to be updated. [ 633.184101] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.184221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.184329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.184516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.184592] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.184688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.184753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.184893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.184972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.185069] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.185212] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.185296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.185357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.185495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.185631] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.185722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.185825] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.186024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.186024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.186083] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.186156] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.228108] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.228108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.228108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.228321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.228321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.252106] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: IN_PROGRESS for 2s [ 633.690768] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fea7482e-7e57-4680-8c8a-3228e37bba95: rpc.has_security_group_logging(os_id): False [ 633.710273] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.710273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.710273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.710273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.710273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.710890] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.710890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.710890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.710890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.710890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.712108] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.712108] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.712108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.712750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.712750] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 is going to be created. [ 633.779279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.779488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.780247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.780247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.780247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.794340] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: IN_PROGRESS for 2s [ 634.332959] env[69360]: INFO networking_nsxv3.common.synchronization [None req-66e05c16-bdcc-460c-ba85-736efa5b8fa7 None None] Enqueued Resource ID: 45c70d00-3271-476b-a05f-f51b305a6538 with Priority: HIGHEST for action port [ 634.333244] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c70d00-3271-476b-a05f-f51b305a6538 with Priority: HIGHEST for action port [ 634.333817] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-45c70d00-3271-476b-a05f-f51b305a6538 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.333954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45c70d00-3271-476b-a05f-f51b305a6538" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.334043] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45c70d00-3271-476b-a05f-f51b305a6538" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.334520] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45c70d00-3271-476b-a05f-f51b305a6538" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.334520] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45c70d00-3271-476b-a05f-f51b305a6538',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.745907] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: SUCCESS [ 634.746191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.842099] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45c70d00-3271-476b-a05f-f51b305a6538 [ 634.842099] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.842234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.842302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.842524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.842613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.842710] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45c70d00-3271-476b-a05f-f51b305a6538 already deleted. [ 634.842810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45c70d00-3271-476b-a05f-f51b305a6538" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.267930] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0fbef34-d753-4a4a-92ea-55434312119d in Status: SUCCESS [ 635.267930] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0fbef34-d753-4a4a-92ea-55434312119d deletion is rescheduled due to dependency. [ 635.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.354717] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7eb25004-7985-41a2-814e-ce21613a735f tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 635.355176] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 635.355474] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.355597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.355663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.356070] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.356070] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.560928] env[69360]: INFO networking_nsxv3.common.synchronization [None req-52dbb347-d69e-4fdc-9542-ec2c5618e240 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 635.560928] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 635.560928] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.561980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.784117] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ae7268ed-b505-40a0-b95b-09cff05d9663 None None] Enqueued Resource ID: 21e4465c-2759-49c6-b979-6f335c0abee3 with Priority: HIGHEST for action port [ 635.785557] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e4465c-2759-49c6-b979-6f335c0abee3 with Priority: HIGHEST for action port [ 635.785557] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e4465c-2759-49c6-b979-6f335c0abee3 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.785557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e4465c-2759-49c6-b979-6f335c0abee3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.785557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e4465c-2759-49c6-b979-6f335c0abee3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.785557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e4465c-2759-49c6-b979-6f335c0abee3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.785907] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e4465c-2759-49c6-b979-6f335c0abee3',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.807887] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: SUCCESS [ 635.807887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.884784] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.884934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.885019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.885307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.885666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.885666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 already deleted. [ 635.885666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.885795] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.885944] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.887169] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.289381] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21e4465c-2759-49c6-b979-6f335c0abee3 [ 636.289503] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.289587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.289715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.290114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.290114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.290266] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21e4465c-2759-49c6-b979-6f335c0abee3 already deleted. [ 636.290266] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e4465c-2759-49c6-b979-6f335c0abee3" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.413605] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.413746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.413831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.414071] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.414165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.414287] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 already deleted. [ 636.414391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.282390] env[69360]: INFO networking_nsxv3.common.synchronization [req-60cb02e4-845c-48dc-b93d-4834b21efeca req-061d8129-2174-4784-868d-4c919e5c5560 tempest-ServerDiagnosticsTest-302831517 tempest-ServerDiagnosticsTest-302831517-project-member] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 637.283008] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGHEST for action security_group_members [ 637.283343] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.283475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.283527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.283749] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.287514] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.287656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.289209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.289209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.289209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.289209] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.370348] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5ed119e7-ef1c-41e9-9590-e239d5d869b7 None None] Enqueued Resource ID: c3facaf9-990a-4e44-adf2-23da888f361f with Priority: HIGHEST for action port [ 637.371016] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3facaf9-990a-4e44-adf2-23da888f361f with Priority: HIGHEST for action port [ 637.371326] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3facaf9-990a-4e44-adf2-23da888f361f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.371457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3facaf9-990a-4e44-adf2-23da888f361f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.371527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3facaf9-990a-4e44-adf2-23da888f361f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.371845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3facaf9-990a-4e44-adf2-23da888f361f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.371970] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3facaf9-990a-4e44-adf2-23da888f361f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.791406] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.791406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.792659] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.792659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.792659] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 is going to be updated. [ 637.821326] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.821583] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.821583] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.822192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.822192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.830980] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: IN_PROGRESS for 2s [ 637.874415] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3facaf9-990a-4e44-adf2-23da888f361f [ 637.874692] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.874839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.874935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.875252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.875359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.875476] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3facaf9-990a-4e44-adf2-23da888f361f already deleted. [ 637.875588] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3facaf9-990a-4e44-adf2-23da888f361f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.331475] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f627ec88-7fbb-4c2d-977d-54c097c1d824 None None] Enqueued Resource ID: d8e84c5f-2ee2-489d-91ed-ae18353c2962 with Priority: HIGHEST for action port [ 638.331475] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8e84c5f-2ee2-489d-91ed-ae18353c2962 with Priority: HIGHEST for action port [ 638.335199] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8e84c5f-2ee2-489d-91ed-ae18353c2962 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.335199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8e84c5f-2ee2-489d-91ed-ae18353c2962" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.336335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8e84c5f-2ee2-489d-91ed-ae18353c2962" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.336335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8e84c5f-2ee2-489d-91ed-ae18353c2962" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.336335] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8e84c5f-2ee2-489d-91ed-ae18353c2962',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.661953] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 638.663061] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 638.663061] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 638.663061] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 638.666360] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.666360] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.666360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.666360] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.668554] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.670556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.670688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.671592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.671841] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.672476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.672587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.672805] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.673332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.674448] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_rules [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [req-e3d0ffbb-ed68-45f4-9923-48075aa5c403 req-cfaf5a27-cbb9-4453-ae15-9e1b8c6283f6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_rules [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 638.764020] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 638.764713] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 638.765121] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.767028] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.767028] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.767028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.767480] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.768563] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-013efad5-0b57-43e9-b662-10e31d24d8af taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.768897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.769066] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.769323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.769493] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013efad5-0b57-43e9-b662-10e31d24d8af',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.770623] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.770913] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.771217] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.771411] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.838551] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8e84c5f-2ee2-489d-91ed-ae18353c2962 [ 638.838551] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.838704] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.838740] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.838972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.839110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.839234] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8e84c5f-2ee2-489d-91ed-ae18353c2962 already deleted. [ 638.839320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8e84c5f-2ee2-489d-91ed-ae18353c2962" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.049495] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f03f2179-14f0-4f87-be03-858303cdd060 None None] Enqueued Resource ID: 9c1c7273-8892-4945-8536-93ab3af9243c with Priority: HIGHEST for action port [ 639.052200] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1c7273-8892-4945-8536-93ab3af9243c with Priority: HIGHEST for action port [ 639.052200] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c1c7273-8892-4945-8536-93ab3af9243c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.052200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c1c7273-8892-4945-8536-93ab3af9243c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.052200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c1c7273-8892-4945-8536-93ab3af9243c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.052200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c1c7273-8892-4945-8536-93ab3af9243c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.052200] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c1c7273-8892-4945-8536-93ab3af9243c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.176885] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.177963] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.272557] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.276025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.276025] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013efad5-0b57-43e9-b662-10e31d24d8af with status ACTIVE [ 639.276025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.276025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.276025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.276785] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.276785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.276785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.276785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.276785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.276785] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013efad5-0b57-43e9-b662-10e31d24d8af is going to be updated. [ 639.304161] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.304675] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.304879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.305867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.305867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.305867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.558846] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c1c7273-8892-4945-8536-93ab3af9243c [ 639.558846] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.558846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.558846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.558846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.558846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.558846] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c1c7273-8892-4945-8536-93ab3af9243c already deleted. [ 639.558846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c1c7273-8892-4945-8536-93ab3af9243c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.680420] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.682277] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.845414] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d4f9a399-698a-42da-8c89-814b7c1e7204 in Status: SUCCESS [ 639.845414] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 deletion is rescheduled due to dependency. [ 639.845414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.182041] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.182220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.182271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.182528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.182609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.182661] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 640.184529] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.184699] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.185753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.185753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.185753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.187970] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be created. [ 640.227032] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.227032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.227248] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.227388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.227568] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.237018] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.237018] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.237018] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.237018] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.237018] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.242259] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: UNINITIALIZED for 2s [ 640.245844] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 641.617983] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 641.618283] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 641.618393] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 641.618874] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 641.619018] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 641.619117] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 641.619384] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.619487] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.619698] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.619786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.619956] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.620069] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.620133] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.620417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.620616] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.620688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.620732] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.620873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.620956] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.621063] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.890373] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_rules [ 641.891138] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 641.891138] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_rules [ 641.891138] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 641.891138] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 641.891138] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 641.891402] env[69360]: INFO networking_nsxv3.common.synchronization [req-8cdca0b3-9987-4484-8dbf-a2041771d031 req-6a9a5874-a184-4fb7-8130-e3aed3b391b6 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_rules [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_rules [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 013efad5-0b57-43e9-b662-10e31d24d8af with Priority: HIGHEST for action port [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 641.896158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 641.896158] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.896158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.896158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.896158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.896158] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.896702] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.896702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.896702] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.896834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.896949] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-013efad5-0b57-43e9-b662-10e31d24d8af taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.898490] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.898586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.898820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.898913] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('013efad5-0b57-43e9-b662-10e31d24d8af',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.899837] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.899945] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.900163] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.900341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.900907] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.901629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.123356] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.220107] env[69360]: INFO networking_nsxv3.common.synchronization [req-da89b7a9-d8ce-4d71-a741-e22d0c2a0166 req-ecce720b-facc-4b73-9e39-775034553a5b tempest-ImagesNegativeTestJSON-1017324503 tempest-ImagesNegativeTestJSON-1017324503-project-member] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 642.220107] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGHEST for action security_group_members [ 642.222804] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.222804] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.222804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.227834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.227834] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.254828] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 642.254828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.255220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.255220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.255399] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.255523] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.255585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.255738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.255815] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.256337] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.257912] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 642.257912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.258097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.258260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.258716] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.258716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.258716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.258884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.258884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.258970] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.402910] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 013efad5-0b57-43e9-b662-10e31d24d8af with status ACTIVE [ 642.403036] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.403204] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.403273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.403499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.403608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.403929] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.403929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.403929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.404246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.404246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.404365] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.404455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.404513] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.404664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.404760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.404879] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 013efad5-0b57-43e9-b662-10e31d24d8af is going to be updated. [ 642.407134] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.407134] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.428680] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.428840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.428915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.429152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.429294] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.429453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-013efad5-0b57-43e9-b662-10e31d24d8af" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.631509] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.726792] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.730127] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.730127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.730127] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 is going to be updated. [ 642.760342] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.760342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.760342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.760342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.760342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.762577] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.763627] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.767273] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: IN_PROGRESS for 2s [ 643.135402] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.135669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.135812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.136156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.136325] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.136497] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be created. [ 643.162988] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.163150] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.163220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.163441] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.163615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.192152] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: UNINITIALIZED for 2s [ 643.268765] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.269688] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.771841] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.772272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.772272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.774825] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.775212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.775212] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 643.778638] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.778638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.778638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.779178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.779528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.779841] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be updated. [ 643.816606] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.817032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.817032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.817161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.817383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.819364] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.819544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.819544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.819878] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.820074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.832940] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 643.833665] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 644.583666] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a6ef3065-7b95-4dd9-a33e-29fecc96b3bc None None] Enqueued Resource ID: b87c6582-4299-449b-b51a-655a285df959 with Priority: HIGHEST for action port [ 644.586122] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b87c6582-4299-449b-b51a-655a285df959 with Priority: HIGHEST for action port [ 644.586807] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b87c6582-4299-449b-b51a-655a285df959 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.586935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b87c6582-4299-449b-b51a-655a285df959" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.586999] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b87c6582-4299-449b-b51a-655a285df959" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.588393] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b87c6582-4299-449b-b51a-655a285df959" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.588513] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b87c6582-4299-449b-b51a-655a285df959',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.779789] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fea7482e-7e57-4680-8c8a-3228e37bba95 in Status: SUCCESS [ 644.779789] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 deletion is rescheduled due to dependency. [ 644.779789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.092111] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b87c6582-4299-449b-b51a-655a285df959 [ 645.092111] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.092111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.092111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.092111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.092436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.092436] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b87c6582-4299-449b-b51a-655a285df959 already deleted. [ 645.092436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b87c6582-4299-449b-b51a-655a285df959" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.210479] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: SUCCESS [ 645.210479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.210479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.210479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.210479] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.210479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.210479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.213052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.213213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.213481] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.715439] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.849035] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 645.849315] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.850783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 645.851433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.853067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.853298] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.853634] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.853703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.853802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.854013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.854612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.854778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.854921] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.856057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.856307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.856557] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.856833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.856833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.856951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.857086] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.857223] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.857346] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.858355] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.862021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.862021] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.862021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.862021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.862021] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.218988] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.359963] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.362971] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.363944] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.364250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.364250] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.721540] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.722587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.722587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.722587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.722587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.722587] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be updated. [ 646.755049] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.755225] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.755297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.755505] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.756174] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.765765] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: IN_PROGRESS for 2s [ 646.865381] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e: rpc.has_security_group_logging(os_id): False [ 646.866623] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.867849] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.890605] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.890605] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.890605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.890605] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be created. [ 646.953755] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.953755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.953755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.953755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.953755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.963951] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 647.374779] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.374779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.374779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.374779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.374779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.374779] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 647.380548] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.380548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.380548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.380548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.380548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.380548] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be updated. [ 647.411448] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.411448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.411448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.412724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.412724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.415502] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.415502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.415502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.415502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.415502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.441965] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 647.443287] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 647.587555] env[69360]: INFO networking_nsxv3.common.synchronization [None req-cb7cc93c-ea79-4bab-8fe2-0f781e3201d2 None None] Enqueued Resource ID: 3af78cf9-38ca-4d9e-be2f-238dae52a67f with Priority: HIGHEST for action port [ 647.587555] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af78cf9-38ca-4d9e-be2f-238dae52a67f with Priority: HIGHEST for action port [ 647.589028] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af78cf9-38ca-4d9e-be2f-238dae52a67f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.589028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af78cf9-38ca-4d9e-be2f-238dae52a67f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.589028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af78cf9-38ca-4d9e-be2f-238dae52a67f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.589028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af78cf9-38ca-4d9e-be2f-238dae52a67f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.589028] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af78cf9-38ca-4d9e-be2f-238dae52a67f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.094652] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3af78cf9-38ca-4d9e-be2f-238dae52a67f [ 648.094652] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.094652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.094652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.094652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.094652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.094652] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3af78cf9-38ca-4d9e-be2f-238dae52a67f already deleted. [ 648.094652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af78cf9-38ca-4d9e-be2f-238dae52a67f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.776984] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: SUCCESS [ 648.777177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.777497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.777699] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.777777] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.777912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.777951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.779030] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.779030] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.779030] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.779030] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.978401] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 648.978401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.978401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.978661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.978704] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.280556] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.455831] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 649.456082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.456819] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 649.456989] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.457165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.457380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.457562] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.457684] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.457751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.457931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.459844] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.459844] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.459980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.460213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.460424] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.460562] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.460630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.460834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.460928] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.461045] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.481054] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.481197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.782937] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 134f4dd0-da38-412e-8a3e-b3a08f7896fa: rpc.has_security_group_logging(os_id): False [ 649.807660] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.807660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.807660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.807926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.808016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.808253] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.808376] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.808420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.808576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.808655] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.808740] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be created. [ 649.875472] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.875472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.875472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.875966] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.877195] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.892581] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: IN_PROGRESS for 2s [ 649.963684] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.964491] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.466696] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.467645] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.971720] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.971720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.971720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.971720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.971720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.971720] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 650.973871] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.973996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.974076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.974256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.974602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.974602] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be updated. [ 651.012079] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.012245] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.012306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.012471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.012885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.016233] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.016409] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.016478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.017146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.017146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.030306] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 651.030907] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 651.908463] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: SUCCESS [ 651.908783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.588863] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 652.589082] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 653.046065] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 653.046362] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.047026] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 653.047203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.047356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.047629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.047753] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.047873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.047942] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.048110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.048421] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.048541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.048637] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.049701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.049701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.049870] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.049936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.049973] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.050127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.050206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.050292] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.050446] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.050920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.050920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.051239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.051398] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.051493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.051598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.051774] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.051774] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.051958] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.051958] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.478768] env[69360]: INFO networking_nsxv3.common.synchronization [req-deeafe0b-7731-4feb-8d59-141ef277c88d req-97eab67c-6c53-4035-9530-873b5d6e3609 tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 653.478768] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 653.478768] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.478768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.478768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.479115] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.479314] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.479492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.479572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.479777] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.479893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.480033] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.553790] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.555885] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 653.568197] env[69360]: INFO networking_nsxv3.common.synchronization [None req-cf21e16a-9026-470e-85c2-b03c986a1728 None None] Enqueued Resource ID: 203345ce-f489-4b95-835a-1d2254797ffa with Priority: HIGHEST for action port [ 653.568449] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203345ce-f489-4b95-835a-1d2254797ffa with Priority: HIGHEST for action port [ 653.568979] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-203345ce-f489-4b95-835a-1d2254797ffa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.569119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203345ce-f489-4b95-835a-1d2254797ffa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.569189] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203345ce-f489-4b95-835a-1d2254797ffa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.569431] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203345ce-f489-4b95-835a-1d2254797ffa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.569514] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203345ce-f489-4b95-835a-1d2254797ffa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.573702] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.574462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.574462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.574462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.574462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.574462] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.574672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.574672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.574672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.574820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.574958] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.575206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.575268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.575410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.575480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.575661] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.575791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.575839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.575941] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.576126] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.576126] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 653.636438] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5063e21a-5c07-4476-84f3-05adce9c0b01 None None] Enqueued Resource ID: c5afcb77-d758-4e17-81ac-17d91b4cce9e with Priority: HIGHEST for action port [ 653.636622] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5afcb77-d758-4e17-81ac-17d91b4cce9e with Priority: HIGHEST for action port [ 653.637735] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5afcb77-d758-4e17-81ac-17d91b4cce9e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.637735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5afcb77-d758-4e17-81ac-17d91b4cce9e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.637735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5afcb77-d758-4e17-81ac-17d91b4cce9e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.637735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5afcb77-d758-4e17-81ac-17d91b4cce9e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.637735] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5afcb77-d758-4e17-81ac-17d91b4cce9e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.644436] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.644901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.645074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.645187] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.645505] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.661722] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 653.987379] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.987587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.987636] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.987886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.988196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.988240] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.988339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.988395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.988549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.988626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.988697] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 already deleted. [ 653.988839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.058069] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e: rpc.has_security_group_logging(os_id): False [ 654.077676] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.077832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.077901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.078151] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.078252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.078483] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.078590] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.078650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.078811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.078886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.078979] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be updated. [ 654.080794] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 203345ce-f489-4b95-835a-1d2254797ffa [ 654.080977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.081104] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.081169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.081359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.081425] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.081735] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:203345ce-f489-4b95-835a-1d2254797ffa already deleted. [ 654.081867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203345ce-f489-4b95-835a-1d2254797ffa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.139838] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5afcb77-d758-4e17-81ac-17d91b4cce9e [ 654.140079] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.140211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.140286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.140516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.140615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.140715] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5afcb77-d758-4e17-81ac-17d91b4cce9e already deleted. [ 654.140798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5afcb77-d758-4e17-81ac-17d91b4cce9e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.144658] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.146017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.146017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.146017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.146017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.159184] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 654.391291] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.391291] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.391291] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.391291] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.392151] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.392556] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.392556] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.393090] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.393090] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.393418] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.393594] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.393946] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.394043] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.394360] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 654.394360] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.394571] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.417108] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.417108] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 654.417108] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.417108] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.417266] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-fa738fa1-0be4-4506-8e42-73671661dee1 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.417400] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.417435] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.418230] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.418230] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa738fa1-0be4-4506-8e42-73671661dee1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.922885] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.923165] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.923291] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.923572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.923719] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.923889] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port fa738fa1-0be4-4506-8e42-73671661dee1 not found, creating... [ 654.924175] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.924328] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.924443] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.924726] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.924807] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.926227] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.926548] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.927161] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.929599] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.930023] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.930421] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: fa738fa1-0be4-4506-8e42-73671661dee1 is going to be created. [ 654.952230] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.953891] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.953891] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.953891] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.953891] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.953891] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.683477] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 655.683477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.683477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.683477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.683477] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.177569] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 656.177741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.186451] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.186620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.186707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.187366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.187366] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.187366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.187366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.187631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.187631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.187631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.187908] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.691062] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.691402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.691402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.691550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.691726] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.691848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.691918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.692097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.692185] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.692275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.692423] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.692517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.692581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.692720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.692872] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.692982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.693065] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.693208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.693287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.693509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.693509] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.049316] env[69360]: INFO networking_nsxv3.common.synchronization [req-deeafe0b-7731-4feb-8d59-141ef277c88d req-ff27e54f-6599-442d-be7d-a7752506562f service nova] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 657.049316] env[69360]: INFO networking_nsxv3.common.synchronization [req-deeafe0b-7731-4feb-8d59-141ef277c88d req-ff27e54f-6599-442d-be7d-a7752506562f service nova] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 657.049316] env[69360]: INFO networking_nsxv3.common.synchronization [req-deeafe0b-7731-4feb-8d59-141ef277c88d req-ff27e54f-6599-442d-be7d-a7752506562f service nova] Enqueued Resource ID: fa738fa1-0be4-4506-8e42-73671661dee1 with Priority: HIGHEST for action port [ 657.049316] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_rules [ 657.049316] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 657.049582] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa738fa1-0be4-4506-8e42-73671661dee1 with Priority: HIGHEST for action port [ 657.050659] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.050659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.050659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.050799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.050799] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.052983] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.053117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.053183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.053373] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.053539] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.054862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.054862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.054862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.054862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.054862] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.056184] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa738fa1-0be4-4506-8e42-73671661dee1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.056333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.056333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.056436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.056520] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa738fa1-0be4-4506-8e42-73671661dee1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.199569] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 657.216938] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.217116] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.217390] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.217459] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.217494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.217696] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.218543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.218635] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.218965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.218965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.219122] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.219192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.219259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.219406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.219481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.219734] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.219818] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.219880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.220051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.220132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.220211] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 657.287929] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.287929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.287929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.287929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.287929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.302275] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 657.430372] env[69360]: INFO networking_nsxv3.common.synchronization [req-fc0b5fcd-3d01-44ca-949e-8111b34eda65 req-00ec77de-afc6-40d8-891e-26eed63c2378 tempest-TenantUsagesTestJSON-783521288 tempest-TenantUsagesTestJSON-783521288-project-member] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 657.430372] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 657.430720] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.431396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.431396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.431524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.432081] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.432081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.432250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.432427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.432584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.432733] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.554351] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.554351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.559037] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.562468] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa738fa1-0be4-4506-8e42-73671661dee1 with status ACTIVE [ 657.562468] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.562468] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.562468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.564339] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.566029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.566029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.566029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.566029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.566029] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa738fa1-0be4-4506-8e42-73671661dee1 is going to be updated. [ 657.590924] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.591089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.591160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.591372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.591504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.591659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa738fa1-0be4-4506-8e42-73671661dee1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.938098] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.938398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.938398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.938550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.938638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.938831] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.938925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.938985] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.939145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.939217] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.939302] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 already deleted. [ 657.939379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.068573] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.573170] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.573170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.573170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.573170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.573170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.573170] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 is going to be created. [ 658.599421] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.599579] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.599649] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.599865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.600101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.616563] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 in Status: UNINITIALIZED for 2s [ 658.671082] env[69360]: INFO networking_nsxv3.common.synchronization [None req-88b306ae-b023-4d7d-8360-e9bb13e25225 None None] Enqueued Resource ID: 09432096-f648-4299-864b-789311db36cd with Priority: HIGHEST for action port [ 658.671409] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09432096-f648-4299-864b-789311db36cd with Priority: HIGHEST for action port [ 658.671863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-09432096-f648-4299-864b-789311db36cd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.671967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09432096-f648-4299-864b-789311db36cd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.672049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09432096-f648-4299-864b-789311db36cd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.672301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09432096-f648-4299-864b-789311db36cd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.672385] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09432096-f648-4299-864b-789311db36cd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.164454] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6d3977aa-a96d-4bc0-acc1-87a5855f2d79 None None] Enqueued Resource ID: e9101236-91c7-4346-8b26-05cb4e3cbff5 with Priority: HIGHEST for action port [ 659.164454] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9101236-91c7-4346-8b26-05cb4e3cbff5 with Priority: HIGHEST for action port [ 659.171659] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9101236-91c7-4346-8b26-05cb4e3cbff5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.171659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9101236-91c7-4346-8b26-05cb4e3cbff5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.171659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9101236-91c7-4346-8b26-05cb4e3cbff5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.171659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9101236-91c7-4346-8b26-05cb4e3cbff5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.171659] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9101236-91c7-4346-8b26-05cb4e3cbff5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.178340] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09432096-f648-4299-864b-789311db36cd [ 659.178340] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.178340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.178340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.178340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.178340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.178340] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09432096-f648-4299-864b-789311db36cd already deleted. [ 659.178340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09432096-f648-4299-864b-789311db36cd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.317955] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 659.317955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.506152] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ab318045-200e-4398-a30f-6db7bff998d8 None None] Enqueued Resource ID: 5de78da4-84be-485d-8056-ad57f9625742 with Priority: HIGHEST for action port [ 659.506152] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5de78da4-84be-485d-8056-ad57f9625742 with Priority: HIGHEST for action port [ 659.506152] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5de78da4-84be-485d-8056-ad57f9625742 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.506152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5de78da4-84be-485d-8056-ad57f9625742" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.506152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5de78da4-84be-485d-8056-ad57f9625742" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.506763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5de78da4-84be-485d-8056-ad57f9625742" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.507061] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5de78da4-84be-485d-8056-ad57f9625742',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.658722] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.658932] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.659073] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.659345] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.659946] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.660838] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.660984] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.661331] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.661480] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.661719] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.661780] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.661910] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.662076] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.662161] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 659.662270] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.662448] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.671453] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9101236-91c7-4346-8b26-05cb4e3cbff5 [ 659.673211] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.673384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.673651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.673945] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.674062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.674169] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9101236-91c7-4346-8b26-05cb4e3cbff5 already deleted. [ 659.674255] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9101236-91c7-4346-8b26-05cb4e3cbff5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.688140] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.688140] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 659.688140] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.688140] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-433" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.688140] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.688140] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.688140] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.688140] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.688140] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40ba702d-0ae2-48ae-acc0-37f002e4ef6a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.695998] env[69360]: INFO networking_nsxv3.common.synchronization [req-5942d654-cc5c-4cde-951d-9fa7311a189d req-0342a849-b24d-43bb-8987-22ed1cabf27c tempest-ServerTagsTestJSON-810630044 tempest-ServerTagsTestJSON-810630044-project-member] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 659.696528] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 659.697038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.697213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.697274] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.697485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.699519] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.699519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.699519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.699519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.699519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.700773] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.013600] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5de78da4-84be-485d-8056-ad57f9625742 [ 660.013600] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.013600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.013600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.013600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.013600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.013600] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5de78da4-84be-485d-8056-ad57f9625742 already deleted. [ 660.013600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5de78da4-84be-485d-8056-ad57f9625742" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.194545] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.194545] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.194545] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.194545] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.194545] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.195254] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 40ba702d-0ae2-48ae-acc0-37f002e4ef6a not found, creating... [ 660.195254] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.195254] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.195436] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.195558] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.196363] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.196363] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.196363] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.196363] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.196643] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.196643] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.196769] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 40ba702d-0ae2-48ae-acc0-37f002e4ef6a is going to be created. [ 660.206666] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.206666] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.206666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b already deleted. [ 660.206666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.226030] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.226030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.226030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.226030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.226030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.226030] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.625647] env[69360]: INFO networking_nsxv3.common.synchronization [None req-da703670-e647-4d5a-9a2e-820718bd3177 None None] Enqueued Resource ID: fd2a1339-83b3-44c5-80a8-5cac1afbaf5c with Priority: HIGHEST for action port [ 660.626268] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd2a1339-83b3-44c5-80a8-5cac1afbaf5c with Priority: HIGHEST for action port [ 660.626613] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd2a1339-83b3-44c5-80a8-5cac1afbaf5c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.626908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd2a1339-83b3-44c5-80a8-5cac1afbaf5c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.626908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd2a1339-83b3-44c5-80a8-5cac1afbaf5c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.630395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd2a1339-83b3-44c5-80a8-5cac1afbaf5c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.630395] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd2a1339-83b3-44c5-80a8-5cac1afbaf5c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.630395] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 in Status: SUCCESS [ 660.630395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.631569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.631898] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.633146] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.633654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.633654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.633654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.633784] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.634932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.634932] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.139068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd2a1339-83b3-44c5-80a8-5cac1afbaf5c [ 661.139068] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.139068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.139068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.139068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.139068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.139383] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd2a1339-83b3-44c5-80a8-5cac1afbaf5c already deleted. [ 661.139383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd2a1339-83b3-44c5-80a8-5cac1afbaf5c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.139837] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.645208] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57cf0f6c-869d-4d08-b17d-3fb1a59953c5: rpc.has_security_group_logging(os_id): False [ 661.661768] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.662115] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.662115] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.662328] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.662420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.666141] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.666141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.666141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.666141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.666141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.666141] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 is going to be created. [ 661.722633] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.722780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.722875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.723201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.723312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.740581] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 in Status: IN_PROGRESS for 2s [ 662.006367] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-855 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.006367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-855" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.006367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-855" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.006367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-855" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.006367] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.006367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.006367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.007021] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.007021] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.007492] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.007492] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.007704] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.007885] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.007953] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 662.008194] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.008425] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.035499] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.035671] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 662.035824] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.036035] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-855" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.036456] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-b9b8324a-008d-47c5-a1e4-571d6275a798 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.036879] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.037048] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.037412] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.037582] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b8324a-008d-47c5-a1e4-571d6275a798',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.544115] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.544612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.544612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.544807] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.544988] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.545284] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port b9b8324a-008d-47c5-a1e4-571d6275a798 not found, creating... [ 662.545457] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.545612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.545726] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.545991] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.546363] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.546848] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.547252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.547252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.547368] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.547472] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.547808] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: b9b8324a-008d-47c5-a1e4-571d6275a798 is going to be created. [ 662.569161] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.569419] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.569543] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.569815] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.570043] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.570262] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.619371] env[69360]: INFO networking_nsxv3.common.synchronization [None req-cf9d9524-bc55-4494-bd79-dc13963a9bcc None None] Enqueued Resource ID: 829c0da5-b4ba-4205-a040-e037f277acd9 with Priority: HIGHEST for action port [ 662.619371] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829c0da5-b4ba-4205-a040-e037f277acd9 with Priority: HIGHEST for action port [ 662.619371] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-829c0da5-b4ba-4205-a040-e037f277acd9 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.619371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-829c0da5-b4ba-4205-a040-e037f277acd9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.619371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-829c0da5-b4ba-4205-a040-e037f277acd9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.619371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-829c0da5-b4ba-4205-a040-e037f277acd9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.619371] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('829c0da5-b4ba-4205-a040-e037f277acd9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.797398] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-cbc9dd5b-e580-498d-a756-9922dfafdf7e tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 662.799159] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 662.799159] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.799159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.799159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.801283] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.801477] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.801593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.802367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.802367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.802367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.802367] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.103095] env[69360]: INFO networking_nsxv3.common.synchronization [req-fc0b5fcd-3d01-44ca-949e-8111b34eda65 req-420feac8-3bb5-4622-87a0-8acf1c18c15b service nova] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_rules [ 663.103662] env[69360]: INFO networking_nsxv3.common.synchronization [req-fc0b5fcd-3d01-44ca-949e-8111b34eda65 req-420feac8-3bb5-4622-87a0-8acf1c18c15b service nova] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 663.105047] env[69360]: INFO networking_nsxv3.common.synchronization [req-fc0b5fcd-3d01-44ca-949e-8111b34eda65 req-420feac8-3bb5-4622-87a0-8acf1c18c15b service nova] Enqueued Resource ID: 40ba702d-0ae2-48ae-acc0-37f002e4ef6a with Priority: HIGHEST for action port [ 663.105326] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_rules [ 663.106379] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 663.106379] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40ba702d-0ae2-48ae-acc0-37f002e4ef6a with Priority: HIGHEST for action port [ 663.106379] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.106379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.106379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.106728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.106728] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.110111] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.110111] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.110111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.110111] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.111301] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.111301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.111301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.111301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.111301] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40ba702d-0ae2-48ae-acc0-37f002e4ef6a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.122348] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 829c0da5-b4ba-4205-a040-e037f277acd9 [ 663.122566] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.122831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.122831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.123216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.123216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.123324] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:829c0da5-b4ba-4205-a040-e037f277acd9 already deleted. [ 663.123324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-829c0da5-b4ba-4205-a040-e037f277acd9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.307421] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.309271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.309353] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.309582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.309678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.309895] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.310000] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.310083] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.310246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.310320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.310408] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 already deleted. [ 663.311039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.614059] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.615046] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.615176] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.615490] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40ba702d-0ae2-48ae-acc0-37f002e4ef6a with status ACTIVE [ 663.615490] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.615638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.615801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.615932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.616074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.616201] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.616280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.616329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.616480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.616557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.616734] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.616892] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.616892] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.623168] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.623168] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.623168] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40ba702d-0ae2-48ae-acc0-37f002e4ef6a is going to be updated. [ 663.644580] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.644580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.644580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.644824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.644860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.645150] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40ba702d-0ae2-48ae-acc0-37f002e4ef6a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.758783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 in Status: SUCCESS [ 663.758783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.123551] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.627556] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.627926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.628076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.628356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.628459] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.628571] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 is going to be created. [ 664.655052] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.655052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.655052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.655052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.655052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.665188] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: UNINITIALIZED for 2s [ 665.058668] env[69360]: INFO networking_nsxv3.common.synchronization [req-5942d654-cc5c-4cde-951d-9fa7311a189d req-5d3f8e87-df41-4f8c-a36e-bc14e1d6c5cc service nova] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_rules [ 665.058876] env[69360]: INFO networking_nsxv3.common.synchronization [req-5942d654-cc5c-4cde-951d-9fa7311a189d req-5d3f8e87-df41-4f8c-a36e-bc14e1d6c5cc service nova] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 665.059042] env[69360]: INFO networking_nsxv3.common.synchronization [req-5942d654-cc5c-4cde-951d-9fa7311a189d req-5d3f8e87-df41-4f8c-a36e-bc14e1d6c5cc service nova] Enqueued Resource ID: b9b8324a-008d-47c5-a1e4-571d6275a798 with Priority: HIGHEST for action port [ 665.059678] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_rules [ 665.059767] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 665.059906] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9b8324a-008d-47c5-a1e4-571d6275a798 with Priority: HIGHEST for action port [ 665.061977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.062102] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.062145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.062401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.062538] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.063778] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.063900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.063968] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.064156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.064304] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.064399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.064469] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.064630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.064714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.064808] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.066030] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9b8324a-008d-47c5-a1e4-571d6275a798 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.066147] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.066205] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.066361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.066459] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9b8324a-008d-47c5-a1e4-571d6275a798',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.408153] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.408153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.408153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.408153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.408153] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.408153] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.411018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.411018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.411018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.411317] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.411503] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.412148] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.412566] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.413699] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 665.413845] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.414639] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.435134] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.435309] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 665.435450] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.435630] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.435946] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-6de8ad4d-1ee6-4190-bcaa-941184f740e1 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.436139] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.436261] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.436674] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.436813] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de8ad4d-1ee6-4190-bcaa-941184f740e1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.568270] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.568445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.568656] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.569550] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9b8324a-008d-47c5-a1e4-571d6275a798 with status ACTIVE [ 665.569742] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.569885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.569938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.570157] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.570257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.570432] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.570528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.570592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.570744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.570820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.570997] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.571888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.572299] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.572531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.572912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.573126] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9b8324a-008d-47c5-a1e4-571d6275a798 is going to be updated. [ 665.596624] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.596768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.596837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.597540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.597540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.597540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9b8324a-008d-47c5-a1e4-571d6275a798" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.779255] env[69360]: INFO networking_nsxv3.common.synchronization [None req-94537d36-e4b1-40cf-a4b8-4c69be386a2b None None] Enqueued Resource ID: e61c7c3c-917d-42a3-91ca-d45e0b6848c6 with Priority: HIGHEST for action port [ 665.779722] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e61c7c3c-917d-42a3-91ca-d45e0b6848c6 with Priority: HIGHEST for action port [ 665.780440] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e61c7c3c-917d-42a3-91ca-d45e0b6848c6 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.780802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e61c7c3c-917d-42a3-91ca-d45e0b6848c6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.781189] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e61c7c3c-917d-42a3-91ca-d45e0b6848c6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.781650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e61c7c3c-917d-42a3-91ca-d45e0b6848c6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.782456] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e61c7c3c-917d-42a3-91ca-d45e0b6848c6',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.941609] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.941609] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.941609] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.941609] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.941609] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.942217] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 6de8ad4d-1ee6-4190-bcaa-941184f740e1 not found, creating... [ 665.943840] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.947025] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.947025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.949987] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.950179] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 6de8ad4d-1ee6-4190-bcaa-941184f740e1 is going to be created. [ 665.978779] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.978779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.978779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.978779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.978779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.978779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.075530] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.270107] env[69360]: INFO networking_nsxv3.common.synchronization [None req-770f0bb6-9bb5-42fb-a810-e4e9df01df99 None None] Enqueued Resource ID: 2122720e-4c5e-4030-81ee-a266ea930898 with Priority: HIGHEST for action port [ 666.270107] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2122720e-4c5e-4030-81ee-a266ea930898 with Priority: HIGHEST for action port [ 666.270107] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2122720e-4c5e-4030-81ee-a266ea930898 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.270107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2122720e-4c5e-4030-81ee-a266ea930898" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.270107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2122720e-4c5e-4030-81ee-a266ea930898" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.270107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2122720e-4c5e-4030-81ee-a266ea930898" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.270107] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2122720e-4c5e-4030-81ee-a266ea930898',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.285505] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e61c7c3c-917d-42a3-91ca-d45e0b6848c6 [ 666.285746] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.285879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.285962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.286206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.286294] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.286940] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e61c7c3c-917d-42a3-91ca-d45e0b6848c6 already deleted. [ 666.286940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e61c7c3c-917d-42a3-91ca-d45e0b6848c6" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.579858] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.580305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.580305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.580305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.580414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.580450] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b is going to be created. [ 666.608141] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.608141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.608141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.608141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.608141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.619036] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: UNINITIALIZED for 2s [ 666.675816] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: SUCCESS [ 666.676128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.676423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.676664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.677377] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.677737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.677843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.678062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.678146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.678238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.678331] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.935279] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2122720e-4c5e-4030-81ee-a266ea930898 [ 666.935279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.935279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.935279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.935279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.935279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.935279] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2122720e-4c5e-4030-81ee-a266ea930898 already deleted. [ 666.935279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2122720e-4c5e-4030-81ee-a266ea930898" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.092190] env[69360]: INFO networking_nsxv3.common.synchronization [None req-acfcfa1c-ff65-41f5-a4cd-0b3c7700ec4e None None] Enqueued Resource ID: b3152eaf-f4ac-4947-b1df-fa83565bddec with Priority: HIGHEST for action port [ 667.092925] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3152eaf-f4ac-4947-b1df-fa83565bddec with Priority: HIGHEST for action port [ 667.094035] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3152eaf-f4ac-4947-b1df-fa83565bddec taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.094035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3152eaf-f4ac-4947-b1df-fa83565bddec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.094035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3152eaf-f4ac-4947-b1df-fa83565bddec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.094372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3152eaf-f4ac-4947-b1df-fa83565bddec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.094417] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3152eaf-f4ac-4947-b1df-fa83565bddec',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.183644] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.183644] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.183644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.185317] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.186230] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.192019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.192019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.192019] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.192019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.192019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.198479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.198479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.198479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.198479] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.444020] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-04044b2e-9ada-4a7a-9b4a-020647efc43f tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 667.447144] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 667.447869] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.448101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.448218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.449167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.449167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.449167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.449167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.449167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.449167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.449167] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.599718] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3152eaf-f4ac-4947-b1df-fa83565bddec [ 667.600114] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.600225] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.600316] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.600576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.600708] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.600836] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3152eaf-f4ac-4947-b1df-fa83565bddec already deleted. [ 667.600946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3152eaf-f4ac-4947-b1df-fa83565bddec" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.700239] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9363c60-0dc4-4a51-8ca5-3290a7dda024: rpc.has_security_group_logging(os_id): False [ 667.719640] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.719857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.719962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.720385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.720552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.721214] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.721361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.721449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.721653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.721762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.722033] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.722172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.723259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.723474] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.723636] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.723861] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.723992] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.724110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.725269] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.725269] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.725269] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 is going to be created. [ 667.793528] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.793528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.793528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.793528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.793528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.805600] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: IN_PROGRESS for 2s [ 667.844369] env[69360]: INFO networking_nsxv3.common.synchronization [None req-115912d0-ee47-46cc-9abe-224132d6c3b1 None None] Enqueued Resource ID: d40f9384-f6b0-49d1-95b9-131f123215c0 with Priority: HIGHEST for action port [ 667.844369] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d40f9384-f6b0-49d1-95b9-131f123215c0 with Priority: HIGHEST for action port [ 667.844369] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d40f9384-f6b0-49d1-95b9-131f123215c0 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.844369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d40f9384-f6b0-49d1-95b9-131f123215c0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.844369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d40f9384-f6b0-49d1-95b9-131f123215c0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.844369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d40f9384-f6b0-49d1-95b9-131f123215c0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.844369] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d40f9384-f6b0-49d1-95b9-131f123215c0',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.955509] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.348421] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d40f9384-f6b0-49d1-95b9-131f123215c0 [ 668.348817] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.348817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.349020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.350249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.350249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.350249] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d40f9384-f6b0-49d1-95b9-131f123215c0 already deleted. [ 668.350249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d40f9384-f6b0-49d1-95b9-131f123215c0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.460113] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.585162] env[69360]: INFO networking_nsxv3.common.synchronization [None req-12977728-1fba-4f0e-923d-623412d6553f None None] Enqueued Resource ID: 3c038c08-d40c-459d-8264-d108ff764766 with Priority: HIGHEST for action port [ 668.585162] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c038c08-d40c-459d-8264-d108ff764766 with Priority: HIGHEST for action port [ 668.585162] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c038c08-d40c-459d-8264-d108ff764766 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.585531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c038c08-d40c-459d-8264-d108ff764766" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.585531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c038c08-d40c-459d-8264-d108ff764766" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.585676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c038c08-d40c-459d-8264-d108ff764766" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.585783] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c038c08-d40c-459d-8264-d108ff764766',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.633057] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: SUCCESS [ 668.633057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.633057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.633057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.633508] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.633508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.633508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.633508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.633682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.633682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.634675] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.965143] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.965143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.965143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.965143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.965143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.965143] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be created. [ 669.000319] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.000319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.000319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.000319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.000505] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.020354] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: UNINITIALIZED for 2s [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-9308eaea-28b5-4285-a0d4-b71c77a488a2 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-9308eaea-28b5-4285-a0d4-b71c77a488a2 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-9308eaea-28b5-4285-a0d4-b71c77a488a2 service nova] Enqueued Resource ID: 6de8ad4d-1ee6-4190-bcaa-941184f740e1 with Priority: HIGHEST for action port [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 669.053315] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de8ad4d-1ee6-4190-bcaa-941184f740e1 with Priority: HIGHEST for action port [ 669.053315] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.054074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.054074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.054510] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.054641] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.056047] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.056047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.056047] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-6de8ad4d-1ee6-4190-bcaa-941184f740e1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.056286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.056286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.056363] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.056432] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6de8ad4d-1ee6-4190-bcaa-941184f740e1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.088499] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b7e283fd-9ddb-4a37-911c-185d9264c7dd None None] Enqueued Resource ID: 7c332387-95e4-4271-a24e-bf5f0537f661 with Priority: HIGHEST for action port [ 669.090908] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c038c08-d40c-459d-8264-d108ff764766 [ 669.092920] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.092920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.097592] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c038c08-d40c-459d-8264-d108ff764766 already deleted. [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c038c08-d40c-459d-8264-d108ff764766" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.097592] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c332387-95e4-4271-a24e-bf5f0537f661 with Priority: HIGHEST for action port [ 669.097592] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c332387-95e4-4271-a24e-bf5f0537f661 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c332387-95e4-4271-a24e-bf5f0537f661" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c332387-95e4-4271-a24e-bf5f0537f661" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.097592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c332387-95e4-4271-a24e-bf5f0537f661" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.097592] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c332387-95e4-4271-a24e-bf5f0537f661',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.136944] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.137161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.137552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.137812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.138162] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.138453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.138530] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.138882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.139032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.140389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.140763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.140930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.141009] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.141260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.141445] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.141793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.141793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.141793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.142123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.142213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.142310] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.444612] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.444946] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.445120] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.445410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.445684] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.446244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.446244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.446244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.446456] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.446510] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.447041] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.447041] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.447041] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.447041] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.447041] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.447521] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.472132] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.472357] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.472514] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.472748] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.473067] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-a1308824-de04-4736-b17a-57bf0eae53ff taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.473254] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.473387] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.473736] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.473999] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1308824-de04-4736-b17a-57bf0eae53ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.562027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.562027] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6de8ad4d-1ee6-4190-bcaa-941184f740e1 with status ACTIVE [ 669.562027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.562027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.562027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.562027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.562757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.562757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.562757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.562757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.562757] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6de8ad4d-1ee6-4190-bcaa-941184f740e1 is going to be updated. [ 669.586499] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.586499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.586499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.586759] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.586871] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.587088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6de8ad4d-1ee6-4190-bcaa-941184f740e1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.600107] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c332387-95e4-4271-a24e-bf5f0537f661 [ 669.600107] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.600575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.600575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.600575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.600575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.600702] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c332387-95e4-4271-a24e-bf5f0537f661 already deleted. [ 669.600735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c332387-95e4-4271-a24e-bf5f0537f661" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.645337] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d8489e0-bcca-4116-a053-e2f77ca08a2b: rpc.has_security_group_logging(os_id): False [ 669.664268] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.664489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.664489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.664709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.664881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.665051] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.665181] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.665219] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.665360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.665438] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.666737] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.666737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.666737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.666737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669890] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669890] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b is going to be created. [ 669.748244] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.748977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.748977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.748977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.749221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.763040] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: IN_PROGRESS for 2s [ 669.827704] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: SUCCESS [ 669.827704] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.977186] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.977794] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.978145] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.978485] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.978722] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.978844] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port a1308824-de04-4736-b17a-57bf0eae53ff not found, creating... [ 669.979172] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.979342] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.980905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.980905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.980905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.980905] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.980905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.980905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.981432] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.981432] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.981432] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: a1308824-de04-4736-b17a-57bf0eae53ff is going to be created. [ 670.007877] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.007978] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.008223] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.008995] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.008995] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.008995] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.034887] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 671.035243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.035662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.036021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.036322] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.036524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.036646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.036874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.037048] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.037222] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.541252] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.656397] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-766cfe0f-67a8-4f32-b328-a7a254652aa6 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 671.658136] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-766cfe0f-67a8-4f32-b328-a7a254652aa6 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 671.658136] env[69360]: INFO networking_nsxv3.common.synchronization [req-590c774b-b76a-47d6-b0f7-c97f1b6ecfd3 req-766cfe0f-67a8-4f32-b328-a7a254652aa6 service nova] Enqueued Resource ID: a1308824-de04-4736-b17a-57bf0eae53ff with Priority: HIGHEST for action port [ 671.658136] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 671.658136] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 671.658136] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1308824-de04-4736-b17a-57bf0eae53ff with Priority: HIGHEST for action port [ 671.659137] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.659137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.659361] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.659449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.659628] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1308824-de04-4736-b17a-57bf0eae53ff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.659735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.659799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.660035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.660100] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1308824-de04-4736-b17a-57bf0eae53ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.707935] env[69360]: INFO networking_nsxv3.common.synchronization [None req-46da5c14-1b20-415b-8d3e-0aee8172ca60 None None] Enqueued Resource ID: b062e0b9-7afd-438a-9825-8a798ab8b602 with Priority: HIGHEST for action port [ 671.707935] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b062e0b9-7afd-438a-9825-8a798ab8b602 with Priority: HIGHEST for action port [ 671.708500] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b062e0b9-7afd-438a-9825-8a798ab8b602 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.708500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b062e0b9-7afd-438a-9825-8a798ab8b602" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.708500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b062e0b9-7afd-438a-9825-8a798ab8b602" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.708727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b062e0b9-7afd-438a-9825-8a798ab8b602" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.708807] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b062e0b9-7afd-438a-9825-8a798ab8b602',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.780356] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: SUCCESS [ 671.780833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.826079] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3c830cdc-ab4f-4ee5-ad0e-4b840d10792b None None] Enqueued Resource ID: ff51950f-f958-4af3-8545-5960a39fd4b2 with Priority: HIGHEST for action port [ 671.826341] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff51950f-f958-4af3-8545-5960a39fd4b2 with Priority: HIGHEST for action port [ 671.826810] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff51950f-f958-4af3-8545-5960a39fd4b2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.827122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff51950f-f958-4af3-8545-5960a39fd4b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.827122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff51950f-f958-4af3-8545-5960a39fd4b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.827765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff51950f-f958-4af3-8545-5960a39fd4b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.827765] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff51950f-f958-4af3-8545-5960a39fd4b2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.045187] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.163013] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1308824-de04-4736-b17a-57bf0eae53ff with status ACTIVE [ 672.163013] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.163013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.163013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.163013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.163013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.163449] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.163449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.163544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.164439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.164439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.164439] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.164439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.164439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.164707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.164707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.164848] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1308824-de04-4736-b17a-57bf0eae53ff is going to be updated. [ 672.194598] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.194598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.194598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.194832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.195221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.195221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1308824-de04-4736-b17a-57bf0eae53ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.214073] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b062e0b9-7afd-438a-9825-8a798ab8b602 [ 672.214073] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.214073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.214073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.214073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.214073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.214073] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b062e0b9-7afd-438a-9825-8a798ab8b602 already deleted. [ 672.214073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b062e0b9-7afd-438a-9825-8a798ab8b602" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.330470] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff51950f-f958-4af3-8545-5960a39fd4b2 [ 672.330470] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.330470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.330470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.330470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.330470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.330470] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff51950f-f958-4af3-8545-5960a39fd4b2 already deleted. [ 672.330470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff51950f-f958-4af3-8545-5960a39fd4b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.336866] env[69360]: INFO networking_nsxv3.common.synchronization [req-be4e3c2d-b3b5-427c-9eea-12d64490087d req-67de3a05-38f0-42f4-afd2-2d504361e963 tempest-ServersAdminTestJSON-963435758 tempest-ServersAdminTestJSON-963435758-project-member] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 672.337431] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 672.337718] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.337839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.337921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.338596] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.338702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.338770] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.338920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.339008] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.339107] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.548249] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.550092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.550092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.550092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.550092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.550092] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 672.582033] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.582200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.582270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.582478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.582615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.596740] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 672.640966] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7b662a85-096f-4715-966d-cdc46a9b9989 None None] Enqueued Resource ID: fd86bf99-3855-4039-a1c2-33db0892e36f with Priority: HIGHEST for action port [ 672.640966] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd86bf99-3855-4039-a1c2-33db0892e36f with Priority: HIGHEST for action port [ 672.640966] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd86bf99-3855-4039-a1c2-33db0892e36f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.640966] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd86bf99-3855-4039-a1c2-33db0892e36f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.640966] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd86bf99-3855-4039-a1c2-33db0892e36f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.641452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd86bf99-3855-4039-a1c2-33db0892e36f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.641502] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd86bf99-3855-4039-a1c2-33db0892e36f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.681291] env[69360]: INFO networking_nsxv3.common.synchronization [None req-eb430a86-5402-4426-a155-0c6a92e1c2ba tempest-AttachInterfacesUnderV243Test-977744864 tempest-AttachInterfacesUnderV243Test-977744864-project-member] Enqueued Resource ID: efefd560-b6e4-48fb-a711-20541fb254cb with Priority: HIGHEST for action security_group_rules [ 672.681970] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efefd560-b6e4-48fb-a711-20541fb254cb with Priority: HIGHEST for action security_group_rules [ 672.682316] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efefd560-b6e4-48fb-a711-20541fb254cb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.682416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.682483] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.683190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.683190] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efefd560-b6e4-48fb-a711-20541fb254cb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.842790] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.842790] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.842790] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf already deleted. [ 672.842790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.969927] env[69360]: INFO networking_nsxv3.common.synchronization [None req-16a1972d-23b1-49fc-affd-77986f9d5260 tempest-AttachInterfacesUnderV243Test-977744864 tempest-AttachInterfacesUnderV243Test-977744864-project-member] Enqueued Resource ID: efefd560-b6e4-48fb-a711-20541fb254cb with Priority: HIGHEST for action security_group_rules [ 672.969927] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efefd560-b6e4-48fb-a711-20541fb254cb with Priority: HIGHEST for action security_group_rules [ 672.969927] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efefd560-b6e4-48fb-a711-20541fb254cb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.969927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.149183] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd86bf99-3855-4039-a1c2-33db0892e36f [ 673.149481] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.149682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.149682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.149873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.149963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.150072] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd86bf99-3855-4039-a1c2-33db0892e36f already deleted. [ 673.150150] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd86bf99-3855-4039-a1c2-33db0892e36f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.218020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.218020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efefd560-b6e4-48fb-a711-20541fb254cb already deleted. [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.218020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.218020] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efefd560-b6e4-48fb-a711-20541fb254cb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.508881] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0fd3a938-7ae8-4962-83e7-b40c570dd7a3 None None] Enqueued Resource ID: b2d10f9e-2494-49df-9460-44da0e2ef6dd with Priority: HIGHEST for action port [ 673.508881] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d10f9e-2494-49df-9460-44da0e2ef6dd with Priority: HIGHEST for action port [ 673.508881] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2d10f9e-2494-49df-9460-44da0e2ef6dd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.508881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2d10f9e-2494-49df-9460-44da0e2ef6dd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.508881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2d10f9e-2494-49df-9460-44da0e2ef6dd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.509318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2d10f9e-2494-49df-9460-44da0e2ef6dd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.509318] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2d10f9e-2494-49df-9460-44da0e2ef6dd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.742292] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.742755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.742755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.742755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.744097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.744097] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efefd560-b6e4-48fb-a711-20541fb254cb already deleted. [ 673.744097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efefd560-b6e4-48fb-a711-20541fb254cb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.011704] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2d10f9e-2494-49df-9460-44da0e2ef6dd [ 674.012100] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.012190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.012235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.012454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.012560] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.012680] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2d10f9e-2494-49df-9460-44da0e2ef6dd already deleted. [ 674.012774] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2d10f9e-2494-49df-9460-44da0e2ef6dd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.100772] env[69360]: INFO networking_nsxv3.common.synchronization [None req-77442a72-6a61-4248-beb5-987287ee9b15 tempest-ServersV294TestFqdnHostnames-2008691314 tempest-ServersV294TestFqdnHostnames-2008691314-project-member] Enqueued Resource ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 with Priority: HIGHEST for action security_group_rules [ 674.101410] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 with Priority: HIGHEST for action security_group_rules [ 674.101750] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.101900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.102476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.102476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.102476] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d74160b-1cc6-4a91-b186-5b3c6e9ca179',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.487876] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b660a3bd-67e7-4fdd-9e40-9ef6a5a67cb9 tempest-ServersV294TestFqdnHostnames-2008691314 tempest-ServersV294TestFqdnHostnames-2008691314-project-member] Enqueued Resource ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 with Priority: HIGHEST for action security_group_rules [ 674.488858] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 with Priority: HIGHEST for action security_group_rules [ 674.488858] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.488858] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.617319] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 674.617555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.617879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.618083] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.618280] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.618402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.618492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.618625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.618710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.618793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.618893] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.619838] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.622553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.622823] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.622963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.623041] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.623313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.623313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.623457] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.640993] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.641263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.641379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.641670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.641798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.641929] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 already deleted. [ 674.642061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.642601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.642821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.642913] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d74160b-1cc6-4a91-b186-5b3c6e9ca179',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.655987] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.656213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-527" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.656341] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-527" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.656695] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-527" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.656974] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.664572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.664572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.664572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.664572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.664572] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.664572] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.664572] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.664572] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.664572] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.664572] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.664572] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.702999] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.703748] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.706029] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.706029] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-527" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.706029] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-495ec91b-986e-4b74-820f-28ae7f03a86a taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.706029] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.706029] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.706029] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.706029] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('495ec91b-986e-4b74-820f-28ae7f03a86a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.762423] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ebd7dcf0-b950-4a56-97cc-3f59c513b633 tempest-ServerActionsTestOtherA-1360477532 tempest-ServerActionsTestOtherA-1360477532-project-member] Enqueued Resource ID: a7c5e890-9dde-4598-a5af-75bde818101d with Priority: HIGHEST for action security_group_rules [ 674.763225] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c5e890-9dde-4598-a5af-75bde818101d with Priority: HIGHEST for action security_group_rules [ 674.763675] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7c5e890-9dde-4598-a5af-75bde818101d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.763860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.763961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.764337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.764525] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7c5e890-9dde-4598-a5af-75bde818101d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.969291] env[69360]: INFO networking_nsxv3.common.synchronization [None req-586c7607-38b8-4dd1-a087-5ffde1ca6089 tempest-ServerActionsTestOtherA-1360477532 tempest-ServerActionsTestOtherA-1360477532-project-member] Enqueued Resource ID: a7c5e890-9dde-4598-a5af-75bde818101d with Priority: HIGHEST for action security_group_rules [ 674.970604] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7c5e890-9dde-4598-a5af-75bde818101d with Priority: HIGHEST for action security_group_rules [ 674.971286] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7c5e890-9dde-4598-a5af-75bde818101d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.971386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.126441] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.126671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.126849] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.167239] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.169480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.169480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.169480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.169480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.169480] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d74160b-1cc6-4a91-b186-5b3c6e9ca179 already deleted. [ 675.169480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d74160b-1cc6-4a91-b186-5b3c6e9ca179" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.212050] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.212050] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 495ec91b-986e-4b74-820f-28ae7f03a86a not found, creating... [ 675.212050] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.212050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.214323] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.214323] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.214323] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.214522] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.214696] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.214870] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 495ec91b-986e-4b74-820f-28ae7f03a86a is going to be created. [ 675.239847] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.240090] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.240349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.240491] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.240737] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.241344] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.288820] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.289073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.289139] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.289322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.289644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.289644] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7c5e890-9dde-4598-a5af-75bde818101d already deleted. [ 675.289644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.289929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.290210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.290314] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7c5e890-9dde-4598-a5af-75bde818101d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.436898] env[69360]: INFO networking_nsxv3.common.synchronization [None req-931dbe2d-9482-48e8-8e27-0a7c90e54cd1 None None] Enqueued Resource ID: 93cd9c74-6482-4c6d-866f-a9e6f8762513 with Priority: HIGHEST for action port [ 675.439356] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cd9c74-6482-4c6d-866f-a9e6f8762513 with Priority: HIGHEST for action port [ 675.440865] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-93cd9c74-6482-4c6d-866f-a9e6f8762513 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.440865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93cd9c74-6482-4c6d-866f-a9e6f8762513" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.440865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93cd9c74-6482-4c6d-866f-a9e6f8762513" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.441241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93cd9c74-6482-4c6d-866f-a9e6f8762513" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.441278] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93cd9c74-6482-4c6d-866f-a9e6f8762513',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.631733] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.823023] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.823023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.823023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.823023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.823023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.823023] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7c5e890-9dde-4598-a5af-75bde818101d already deleted. [ 675.823023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7c5e890-9dde-4598-a5af-75bde818101d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.944710] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93cd9c74-6482-4c6d-866f-a9e6f8762513 [ 675.945427] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.945427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.945427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.945427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.946234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.946234] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93cd9c74-6482-4c6d-866f-a9e6f8762513 already deleted. [ 675.946234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93cd9c74-6482-4c6d-866f-a9e6f8762513" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.035277] env[69360]: INFO networking_nsxv3.common.synchronization [None req-cb44f22c-bd50-4fec-8cd5-9d7ef545f2fc None None] Enqueued Resource ID: 91e3d2fb-85d4-467a-b002-c00ccaac6471 with Priority: HIGHEST for action port [ 676.035726] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91e3d2fb-85d4-467a-b002-c00ccaac6471 with Priority: HIGHEST for action port [ 676.036260] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-91e3d2fb-85d4-467a-b002-c00ccaac6471 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.037056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91e3d2fb-85d4-467a-b002-c00ccaac6471" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.037056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91e3d2fb-85d4-467a-b002-c00ccaac6471" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.037056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91e3d2fb-85d4-467a-b002-c00ccaac6471" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.037056] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91e3d2fb-85d4-467a-b002-c00ccaac6471',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.133819] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.134103] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.134103] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.134990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.134990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.134990] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 676.167176] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.167860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.167860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.167860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.167860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.179470] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 676.418738] env[69360]: INFO networking_nsxv3.common.synchronization [req-d9768f87-e82d-4504-863b-881652ac1cc8 req-7103de82-1461-4a0d-89c9-d23a5566aa5b tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 1791ce1a-2593-44a1-afec-7fb2f4628eab with Priority: HIGHEST for action security_group_rules [ 676.418738] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1791ce1a-2593-44a1-afec-7fb2f4628eab with Priority: HIGHEST for action security_group_rules [ 676.419540] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1791ce1a-2593-44a1-afec-7fb2f4628eab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.419743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1791ce1a-2593-44a1-afec-7fb2f4628eab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.419875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1791ce1a-2593-44a1-afec-7fb2f4628eab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.420111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1791ce1a-2593-44a1-afec-7fb2f4628eab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.420219] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1791ce1a-2593-44a1-afec-7fb2f4628eab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.539491] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91e3d2fb-85d4-467a-b002-c00ccaac6471 [ 676.539491] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.542415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.542559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.543710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.543710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.543710] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91e3d2fb-85d4-467a-b002-c00ccaac6471 already deleted. [ 676.543710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91e3d2fb-85d4-467a-b002-c00ccaac6471" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.551085] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a967e06f-31a1-435c-ac03-b2e01988cacd None None] Enqueued Resource ID: 1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab with Priority: HIGHEST for action port [ 676.554618] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab with Priority: HIGHEST for action port [ 676.554618] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.554618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.554618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.554618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.554618] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.578174] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5ca8aea8-7e31-4dc0-912f-539c103732ab tempest-ServerActionsV293TestJSON-1803979304 tempest-ServerActionsV293TestJSON-1803979304-project-member] Enqueued Resource ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a with Priority: HIGHEST for action security_group_rules [ 676.579009] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a with Priority: HIGHEST for action security_group_rules [ 676.579393] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3cb7e3-379d-4988-94c9-bce2a405863a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.579611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.579611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.580640] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.580640] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3cb7e3-379d-4988-94c9-bce2a405863a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.781257] env[69360]: INFO networking_nsxv3.common.synchronization [None req-164ad70e-e5a6-47ff-bc58-3b8b3f4922d7 None None] Enqueued Resource ID: d84dbb4d-1414-4416-abcb-a80ff734ca85 with Priority: HIGHEST for action port [ 676.781257] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d84dbb4d-1414-4416-abcb-a80ff734ca85 with Priority: HIGHEST for action port [ 676.781630] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d84dbb4d-1414-4416-abcb-a80ff734ca85 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.781776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d84dbb4d-1414-4416-abcb-a80ff734ca85" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.781998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d84dbb4d-1414-4416-abcb-a80ff734ca85" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.782349] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d84dbb4d-1414-4416-abcb-a80ff734ca85" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.782425] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d84dbb4d-1414-4416-abcb-a80ff734ca85',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.870539] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f10b06c8-5dca-42ab-9805-a428d71832e1 tempest-ServerActionsV293TestJSON-1803979304 tempest-ServerActionsV293TestJSON-1803979304-project-member] Enqueued Resource ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a with Priority: HIGHEST for action security_group_rules [ 676.871108] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a with Priority: HIGHEST for action security_group_rules [ 676.874704] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f3cb7e3-379d-4988-94c9-bce2a405863a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.874704] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.945370] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.945370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.945370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.945370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.945370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.945370] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1791ce1a-2593-44a1-afec-7fb2f4628eab already deleted. [ 676.945370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1791ce1a-2593-44a1-afec-7fb2f4628eab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.057063] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab [ 677.061432] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.061432] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.061432] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.061609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.061717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.061786] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab already deleted. [ 677.061921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e9b6d8f-27ef-45bd-a9e9-9b0798d20fab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.108080] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.108653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.108653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.108653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.108653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.108870] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a already deleted. [ 677.108870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.109024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.109171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.109271] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f3cb7e3-379d-4988-94c9-bce2a405863a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.223721] env[69360]: INFO networking_nsxv3.common.synchronization [req-1a0ea38d-dfc4-4cbb-a9f0-f5ce46f1788e req-895f529a-3368-40f0-bebe-b3becc7c7d94 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 677.225418] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 677.227117] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.227117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.227117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.227117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.227117] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.227117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.227117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.227525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.227700] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.227951] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.286423] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d84dbb4d-1414-4416-abcb-a80ff734ca85 [ 677.286824] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.287067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.287204] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.287545] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.287737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.287930] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d84dbb4d-1414-4416-abcb-a80ff734ca85 already deleted. [ 677.288044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d84dbb4d-1414-4416-abcb-a80ff734ca85" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.399271] env[69360]: INFO networking_nsxv3.common.synchronization [None req-250a6126-a59a-4dea-9e70-50e723bc8525 None None] Enqueued Resource ID: c39796a8-e33a-4481-873d-1bf08781c46f with Priority: HIGHEST for action port [ 677.399698] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39796a8-e33a-4481-873d-1bf08781c46f with Priority: HIGHEST for action port [ 677.400011] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c39796a8-e33a-4481-873d-1bf08781c46f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.400190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c39796a8-e33a-4481-873d-1bf08781c46f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.400237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c39796a8-e33a-4481-873d-1bf08781c46f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.400628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c39796a8-e33a-4481-873d-1bf08781c46f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.400628] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c39796a8-e33a-4481-873d-1bf08781c46f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.633032] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.633032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.633032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.633313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.633380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.634070] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f3cb7e3-379d-4988-94c9-bce2a405863a already deleted. [ 677.634258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f3cb7e3-379d-4988-94c9-bce2a405863a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.648525] env[69360]: INFO networking_nsxv3.common.synchronization [req-be4e3c2d-b3b5-427c-9eea-12d64490087d req-109d2993-9620-43a8-98b9-7188251a9d16 service nova] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_rules [ 677.649399] env[69360]: INFO networking_nsxv3.common.synchronization [req-be4e3c2d-b3b5-427c-9eea-12d64490087d req-109d2993-9620-43a8-98b9-7188251a9d16 service nova] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 677.649399] env[69360]: INFO networking_nsxv3.common.synchronization [req-be4e3c2d-b3b5-427c-9eea-12d64490087d req-109d2993-9620-43a8-98b9-7188251a9d16 service nova] Enqueued Resource ID: 495ec91b-986e-4b74-820f-28ae7f03a86a with Priority: HIGHEST for action port [ 677.649399] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_rules [ 677.649581] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 677.649581] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 495ec91b-986e-4b74-820f-28ae7f03a86a with Priority: HIGHEST for action port [ 677.649870] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.653034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.653034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.653034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.653034] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.653034] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.655070] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.655234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.655478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.655668] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.655778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.655849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.656051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.656189] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.656237] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.660021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-495ec91b-986e-4b74-820f-28ae7f03a86a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.660021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.660021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.660021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.660021] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('495ec91b-986e-4b74-820f-28ae7f03a86a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.732602] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.732602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.732602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.732602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.732602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.732930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.733188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.733404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.734369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.734369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.734369] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 already deleted. [ 677.734369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.903029] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c39796a8-e33a-4481-873d-1bf08781c46f [ 677.903470] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.904552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.904552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.904552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.904552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.904552] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c39796a8-e33a-4481-873d-1bf08781c46f already deleted. [ 677.904552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c39796a8-e33a-4481-873d-1bf08781c46f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.162157] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.162404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.162717] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.164449] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 495ec91b-986e-4b74-820f-28ae7f03a86a with status ACTIVE [ 678.164677] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.164829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.164908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.165220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.165397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.165593] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.166942] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.166991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.167197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.167290] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.170882] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.170882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.170882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.170882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.170882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.170882] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 495ec91b-986e-4b74-820f-28ae7f03a86a is going to be updated. [ 678.192256] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 678.192496] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.192876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.193224] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.193495] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.193624] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.193767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.193883] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.194077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.194191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.194542] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.194632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.194671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.194928] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.194995] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.195097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.195151] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.195303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.195411] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.195498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.195634] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.202845] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.203127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.203127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.203278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.203448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.203651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-495ec91b-986e-4b74-820f-28ae7f03a86a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.545988] env[69360]: INFO networking_nsxv3.common.synchronization [None req-066833d6-f65b-4723-aad9-3bbe3f2dbc36 None None] Enqueued Resource ID: 74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce with Priority: HIGHEST for action port [ 678.545988] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce with Priority: HIGHEST for action port [ 678.548931] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.548931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.548931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.548931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.548931] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.667950] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.697308] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5e5a270-0e63-466e-949b-b541894e9b16: rpc.has_security_group_logging(os_id): False [ 678.716672] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.716830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.717092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.717160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.717208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.717408] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.717514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.717575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.717731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.717807] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.717984] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.718200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.718200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.718444] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.718444] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.718536] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.718603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.718654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.718959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.718959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.718959] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be created. [ 678.786776] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.786963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.786963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.787426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.787613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.800578] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 679.052469] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce [ 679.052831] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.052998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.052998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.053308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.053422] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.053422] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce already deleted. [ 679.053563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c60ad0-3c82-4cc2-ba9c-c9151b20e2ce" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.170776] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.170943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.170943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.171357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.171357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.171357] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf is going to be created. [ 679.222065] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.222250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.222447] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.222619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.222789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.241082] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: UNINITIALIZED for 2s [ 679.259302] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-156 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.259756] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-156" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.260111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-156" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.260611] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-156" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.261167] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.261404] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.261557] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.261963] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.262311] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.262727] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.262908] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.263147] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.263322] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.263446] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 679.263559] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.263710] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.286087] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.286366] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 679.286463] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.287482] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-156" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.287482] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-5401116f-daf2-4db0-b052-7bd1adb63cc1 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.287482] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.287482] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.287699] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.287699] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5401116f-daf2-4db0-b052-7bd1adb63cc1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.354722] env[69360]: INFO networking_nsxv3.common.synchronization [req-4a4e2df7-def0-4f89-8bf6-a91349a96fef req-6530ce32-7d4e-4c15-8311-8bf47c78c07e tempest-ServersTestManualDisk-924480253 tempest-ServersTestManualDisk-924480253-project-member] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 679.357315] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGHEST for action security_group_members [ 679.362690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.363170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.363323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.363670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.363670] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.363863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.363863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.364442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.364442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.364442] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.795213] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.795213] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 5401116f-daf2-4db0-b052-7bd1adb63cc1 not found, creating... [ 679.795213] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.795213] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.807269] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.807269] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.807269] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.807580] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.807796] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.807866] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 5401116f-daf2-4db0-b052-7bd1adb63cc1 is going to be created. [ 679.839244] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.839244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.839244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.839244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.839244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.839244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.870481] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.871191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.871191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.871341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.871408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.871905] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.872011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.872071] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.873020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.873020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.873020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f is going to be updated. [ 679.925212] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.925365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.925365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.925596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.925733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.938954] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: IN_PROGRESS for 2s [ 680.292076] env[69360]: INFO networking_nsxv3.common.synchronization [req-9cef64df-56e2-4367-bfdb-35ad45edebc0 req-75e555d3-3ff4-4ac6-8fd1-e50faaf6de99 tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 3bd27e85-8216-49c9-82d6-06b5071ac40c with Priority: HIGHEST for action security_group_rules [ 680.297964] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd27e85-8216-49c9-82d6-06b5071ac40c with Priority: HIGHEST for action security_group_rules [ 680.297964] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3bd27e85-8216-49c9-82d6-06b5071ac40c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.297964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3bd27e85-8216-49c9-82d6-06b5071ac40c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.297964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3bd27e85-8216-49c9-82d6-06b5071ac40c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.297964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3bd27e85-8216-49c9-82d6-06b5071ac40c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.297964] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3bd27e85-8216-49c9-82d6-06b5071ac40c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.354417] env[69360]: INFO networking_nsxv3.common.synchronization [None req-2907a699-63ce-497b-be9d-8d8db38d62d5 None None] Enqueued Resource ID: 52599294-9ef8-4383-ab38-abb06b13d4e0 with Priority: HIGHEST for action port [ 680.358639] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52599294-9ef8-4383-ab38-abb06b13d4e0 with Priority: HIGHEST for action port [ 680.359945] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-52599294-9ef8-4383-ab38-abb06b13d4e0 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.360172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52599294-9ef8-4383-ab38-abb06b13d4e0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.360275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52599294-9ef8-4383-ab38-abb06b13d4e0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.360633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52599294-9ef8-4383-ab38-abb06b13d4e0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.360761] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52599294-9ef8-4383-ab38-abb06b13d4e0',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.823738] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 680.823738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.823738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.823738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.823939] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.829251] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.831859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.831859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.831859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.831859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.831859] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3bd27e85-8216-49c9-82d6-06b5071ac40c already deleted. [ 680.831859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3bd27e85-8216-49c9-82d6-06b5071ac40c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.868653] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52599294-9ef8-4383-ab38-abb06b13d4e0 [ 680.868653] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.868653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.869538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.869538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.869603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.869766] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52599294-9ef8-4383-ab38-abb06b13d4e0 already deleted. [ 680.869895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52599294-9ef8-4383-ab38-abb06b13d4e0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.091341] env[69360]: INFO networking_nsxv3.common.synchronization [req-1a0ea38d-dfc4-4cbb-a9f0-f5ce46f1788e req-4c8cd886-3fc7-4c61-8fe5-c5c17f5ad1fa service nova] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 681.092020] env[69360]: INFO networking_nsxv3.common.synchronization [req-1a0ea38d-dfc4-4cbb-a9f0-f5ce46f1788e req-4c8cd886-3fc7-4c61-8fe5-c5c17f5ad1fa service nova] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 681.092697] env[69360]: INFO networking_nsxv3.common.synchronization [req-1a0ea38d-dfc4-4cbb-a9f0-f5ce46f1788e req-4c8cd886-3fc7-4c61-8fe5-c5c17f5ad1fa service nova] Enqueued Resource ID: 5401116f-daf2-4db0-b052-7bd1adb63cc1 with Priority: HIGHEST for action port [ 681.092999] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_rules [ 681.093310] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 681.093504] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5401116f-daf2-4db0-b052-7bd1adb63cc1 with Priority: HIGHEST for action port [ 681.096701] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.096701] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.096701] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.096701] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.096701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.096701] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.100871] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5401116f-daf2-4db0-b052-7bd1adb63cc1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.100993] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.101442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.101638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.101720] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5401116f-daf2-4db0-b052-7bd1adb63cc1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.256127] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: SUCCESS [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.256127] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.256127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.256127] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.328256] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.328618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.328618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.328738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.328938] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.329054] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.329248] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.329330] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.329361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.329703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.329703] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.602634] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.606495] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.606495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.606495] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5401116f-daf2-4db0-b052-7bd1adb63cc1 with status ACTIVE [ 681.606495] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.606495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.606495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.606837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.606837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.606940] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.607139] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.607312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.607449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.607563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.607794] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.608020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.608020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.608226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.608355] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.608626] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5401116f-daf2-4db0-b052-7bd1adb63cc1 is going to be updated. [ 681.639541] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.639541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.639541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.639541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.639541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.639541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5401116f-daf2-4db0-b052-7bd1adb63cc1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.682430] env[69360]: INFO networking_nsxv3.common.synchronization [req-39e01228-3e3c-4114-afc9-ee22a5731ffc req-449fad11-5af8-41d1-a40f-2daa610347ad tempest-TenantUsagesTestJSON-783521288 tempest-TenantUsagesTestJSON-783521288-project-member] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 681.682961] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGHEST for action security_group_members [ 681.683273] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.683399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.683465] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.683669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.683987] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.683987] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.683987] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.686223] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.686332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.686449] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.720299] env[69360]: INFO networking_nsxv3.common.synchronization [None req-d628efea-9679-412b-a6ec-0ad06f83c6e2 None None] Enqueued Resource ID: 7d064657-0f56-48f1-b35f-2f8164628d01 with Priority: HIGHEST for action port [ 681.720811] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d064657-0f56-48f1-b35f-2f8164628d01 with Priority: HIGHEST for action port [ 681.721673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d064657-0f56-48f1-b35f-2f8164628d01 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.723343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d064657-0f56-48f1-b35f-2f8164628d01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.723343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d064657-0f56-48f1-b35f-2f8164628d01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.723343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d064657-0f56-48f1-b35f-2f8164628d01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.723343] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d064657-0f56-48f1-b35f-2f8164628d01',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.758265] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.758471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.758581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.758816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.758999] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.760840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.761032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.762856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.762987] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.763109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.763314] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.763478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.763520] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.763709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.763874] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.764169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.764169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.764259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.764288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.764364] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.764456] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.831279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.831462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.831524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.831883] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.832178] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.832347] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.832452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.832705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.832913] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.833027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.833184] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.833286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.833351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.833509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.833644] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.833738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.833801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.833937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.838190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.838416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.838549] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.953034] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8e6f228-ab6c-4d13-b101-bef38530e43f in Status: SUCCESS [ 681.953287] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f deletion is rescheduled due to dependency. [ 681.953423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.109329] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.188692] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.188929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.189000] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.189233] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.189323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.189525] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.189621] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.189681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.189946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.190041] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.190167] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 is going to be updated. [ 682.223093] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.223093] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.223259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.223335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.223477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.227700] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d064657-0f56-48f1-b35f-2f8164628d01 [ 682.227862] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.227997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.228056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.228255] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.228337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.228427] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d064657-0f56-48f1-b35f-2f8164628d01 already deleted. [ 682.228505] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d064657-0f56-48f1-b35f-2f8164628d01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.239053] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: IN_PROGRESS for 2s [ 682.268068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a55b27fd-fe87-4592-84d0-620efe1b57cf: rpc.has_security_group_logging(os_id): False [ 682.290589] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.290589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.290589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.290742] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.290742] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.291089] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.291089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.291089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.291289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.291330] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.291527] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.291654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.291717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.291816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.291971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.292508] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.292650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.292716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.292909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.292995] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.293097] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf is going to be created. [ 682.346289] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5e5a270-0e63-466e-949b-b541894e9b16: rpc.has_security_group_logging(os_id): False [ 682.367278] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.367451] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.367497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.367709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.367895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.374146] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.374146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.374146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.374715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.374715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.374715] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.374805] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.374832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.375183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.375183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.375277] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.375321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.375370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.375506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.375577] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.375749] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.375845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.375897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.376896] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.377130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.377308] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 682.380060] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: IN_PROGRESS for 2s [ 682.463813] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.463963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.464044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.464339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.464485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.499621] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 682.610843] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.611022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.611092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.611298] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.611948] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.611948] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 is going to be created. [ 682.644191] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.644345] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.644479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.644687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.644936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.659044] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: UNINITIALIZED for 2s [ 683.416605] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ca3a91a2-f959-4fa5-9614-c57fe0e268fb None None] Enqueued Resource ID: 6cf6f16b-386c-42a8-8bea-c93ef84b4c37 with Priority: HIGHEST for action port [ 683.416605] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cf6f16b-386c-42a8-8bea-c93ef84b4c37 with Priority: HIGHEST for action port [ 683.417340] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-6cf6f16b-386c-42a8-8bea-c93ef84b4c37 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.418097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6cf6f16b-386c-42a8-8bea-c93ef84b4c37" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.418097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6cf6f16b-386c-42a8-8bea-c93ef84b4c37" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.418097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6cf6f16b-386c-42a8-8bea-c93ef84b4c37" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.418097] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6cf6f16b-386c-42a8-8bea-c93ef84b4c37',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.571163] env[69360]: INFO networking_nsxv3.common.synchronization [None req-112ec046-62a0-45a2-bcae-7818936f60d6 None None] Enqueued Resource ID: 4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f with Priority: HIGHEST for action port [ 683.571163] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f with Priority: HIGHEST for action port [ 683.571163] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.571163] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.571163] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.572493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.572584] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.922599] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6cf6f16b-386c-42a8-8bea-c93ef84b4c37 [ 683.922599] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.922599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.922599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.922599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.922599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.922599] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6cf6f16b-386c-42a8-8bea-c93ef84b4c37 already deleted. [ 683.922599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6cf6f16b-386c-42a8-8bea-c93ef84b4c37" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.948364] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0aaeba38-8f35-4151-aa79-a8535126899f None None] Enqueued Resource ID: 15daccec-afdb-4a07-800c-25dc9e0b03e9 with Priority: HIGHEST for action port [ 683.948364] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15daccec-afdb-4a07-800c-25dc9e0b03e9 with Priority: HIGHEST for action port [ 683.950731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-15daccec-afdb-4a07-800c-25dc9e0b03e9 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.951297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15daccec-afdb-4a07-800c-25dc9e0b03e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.951297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15daccec-afdb-4a07-800c-25dc9e0b03e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.951297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15daccec-afdb-4a07-800c-25dc9e0b03e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.951428] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15daccec-afdb-4a07-800c-25dc9e0b03e9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.080018] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f [ 684.080347] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.080500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.080575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.080855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.080900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.080981] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f already deleted. [ 684.081096] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bfef0fb-2ef7-4b37-ac9f-4bd0fc34c71f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.088942] env[69360]: INFO networking_nsxv3.common.synchronization [req-7ea72b06-f118-4081-a1da-b80a3541e1aa req-7aa2a636-9b01-4c28-8f4a-af90c8c59e2b tempest-SecurityGroupRulesNegativeTestJSON-800832199 tempest-SecurityGroupRulesNegativeTestJSON-800832199-project-member] Enqueued Resource ID: 5a728758-78d6-41ad-8037-cfc7e773903c with Priority: HIGHEST for action security_group_rules [ 684.089333] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a728758-78d6-41ad-8037-cfc7e773903c with Priority: HIGHEST for action security_group_rules [ 684.089663] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a728758-78d6-41ad-8037-cfc7e773903c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.089780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.089888] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.090592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.090704] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a728758-78d6-41ad-8037-cfc7e773903c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.250912] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 in Status: SUCCESS [ 684.251108] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 deletion is rescheduled due to dependency. [ 684.251220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.394321] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: SUCCESS [ 684.394493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.405134] env[69360]: INFO networking_nsxv3.common.synchronization [req-50a8e40f-2a99-45cf-b1d7-a884ed535307 req-64353cdb-c0e0-48d9-9b01-93364e8b226a tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 0afc03a0-afe6-4433-832c-df6e2ac85b2b with Priority: HIGHEST for action security_group_rules [ 684.405957] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0afc03a0-afe6-4433-832c-df6e2ac85b2b with Priority: HIGHEST for action security_group_rules [ 684.406361] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0afc03a0-afe6-4433-832c-df6e2ac85b2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.406547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0afc03a0-afe6-4433-832c-df6e2ac85b2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.406654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0afc03a0-afe6-4433-832c-df6e2ac85b2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.407508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0afc03a0-afe6-4433-832c-df6e2ac85b2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.407647] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0afc03a0-afe6-4433-832c-df6e2ac85b2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.455783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15daccec-afdb-4a07-800c-25dc9e0b03e9 [ 684.456160] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.456234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.456270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.456821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.456821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.456821] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15daccec-afdb-4a07-800c-25dc9e0b03e9 already deleted. [ 684.460085] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15daccec-afdb-4a07-800c-25dc9e0b03e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.519120] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 684.519424] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.617253] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.617621] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.617621] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.617728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.617757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.618493] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a728758-78d6-41ad-8037-cfc7e773903c already deleted. [ 684.618493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.672461] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: SUCCESS [ 684.674385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.674385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.674593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.675593] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.675593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.675593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.675593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.675593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.675593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.675593] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.937499] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.937499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.937499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.937499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.937836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.937836] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0afc03a0-afe6-4433-832c-df6e2ac85b2b already deleted. [ 684.937836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0afc03a0-afe6-4433-832c-df6e2ac85b2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.180614] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.684134] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfd13ad9-86ad-486c-98eb-041e0786ee19: rpc.has_security_group_logging(os_id): False [ 685.767471] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.767471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.767471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.767471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.767471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.767797] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.767797] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.767797] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.767955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.768183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.768278] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 is going to be created. [ 685.774692] env[69360]: INFO networking_nsxv3.common.synchronization [None req-208d02ed-f56f-4fc8-adae-d669f6ebffe3 None None] Enqueued Resource ID: b3d0255f-42f2-48c8-a690-58153f6d83b2 with Priority: HIGHEST for action port [ 685.774967] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3d0255f-42f2-48c8-a690-58153f6d83b2 with Priority: HIGHEST for action port [ 685.775572] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3d0255f-42f2-48c8-a690-58153f6d83b2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.776674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3d0255f-42f2-48c8-a690-58153f6d83b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.776674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3d0255f-42f2-48c8-a690-58153f6d83b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.776674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3d0255f-42f2-48c8-a690-58153f6d83b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.776674] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d0255f-42f2-48c8-a690-58153f6d83b2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.819509] env[69360]: INFO networking_nsxv3.common.synchronization [req-4cea358a-58d4-488a-ae58-3fefc20cc599 req-2281b915-0a81-406e-9d8f-f86326ea177f tempest-SecurityGroupRulesNegativeTestJSON-800832199 tempest-SecurityGroupRulesNegativeTestJSON-800832199-project-member] Enqueued Resource ID: 5a728758-78d6-41ad-8037-cfc7e773903c with Priority: HIGHEST for action security_group_rules [ 685.821366] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a728758-78d6-41ad-8037-cfc7e773903c with Priority: HIGHEST for action security_group_rules [ 685.821366] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a728758-78d6-41ad-8037-cfc7e773903c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.821677] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.821872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.823929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.823929] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a728758-78d6-41ad-8037-cfc7e773903c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.883362] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.883506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.883592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.883801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.883980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.906516] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: IN_PROGRESS for 2s [ 685.974085] env[69360]: INFO networking_nsxv3.common.synchronization [None req-bc9d3b3f-79d5-4445-ac8d-c3b9d851b383 tempest-VolumesAdminNegativeTest-6889650 tempest-VolumesAdminNegativeTest-6889650-project-member] Enqueued Resource ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c with Priority: HIGHEST for action security_group_rules [ 685.977158] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c with Priority: HIGHEST for action security_group_rules [ 685.977158] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190bb28d-a8ed-49c9-af6f-cad507f6033c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.977158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.977158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.977158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.977158] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190bb28d-a8ed-49c9-af6f-cad507f6033c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.138465] env[69360]: INFO networking_nsxv3.common.synchronization [None req-36758644-5cd9-4c72-ada2-f053048acf4f tempest-VolumesAdminNegativeTest-6889650 tempest-VolumesAdminNegativeTest-6889650-project-member] Enqueued Resource ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c with Priority: HIGHEST for action security_group_rules [ 686.139413] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c with Priority: HIGHEST for action security_group_rules [ 686.139536] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190bb28d-a8ed-49c9-af6f-cad507f6033c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.139596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.277631] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3d0255f-42f2-48c8-a690-58153f6d83b2 [ 686.278096] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.278287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.278359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.278585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.278663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.278965] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3d0255f-42f2-48c8-a690-58153f6d83b2 already deleted. [ 686.278965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3d0255f-42f2-48c8-a690-58153f6d83b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.345965] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.345965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.345965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.345965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.345965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.345965] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a728758-78d6-41ad-8037-cfc7e773903c already deleted. [ 686.345965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a728758-78d6-41ad-8037-cfc7e773903c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.502668] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.502872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.502969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.503272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.503401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.503554] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c already deleted. [ 686.503671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.503895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.504144] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.504248] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190bb28d-a8ed-49c9-af6f-cad507f6033c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.693498] env[69360]: INFO networking_nsxv3.common.synchronization [req-02258f01-0f7a-47d5-8f19-e7e1d8fc8a57 req-76addc15-af41-4a7a-b98a-2c3a1f507b17 tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 686.694567] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 686.695016] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.695710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.695710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.695955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.696219] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.696396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.696567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.696837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.696960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.697076] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.030358] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.030358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.030358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.030358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.030358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.030358] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190bb28d-a8ed-49c9-af6f-cad507f6033c already deleted. [ 687.030358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190bb28d-a8ed-49c9-af6f-cad507f6033c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.199788] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.683316] env[69360]: INFO networking_nsxv3.common.synchronization [req-91e9d1ea-2ff5-4ae3-a101-b6ada7c4acd5 req-11c31145-e73b-49ef-bb9a-2d472c39238c tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 687.683861] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 687.684514] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.684633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.701812] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.772225] env[69360]: INFO networking_nsxv3.common.synchronization [req-1bd0e465-fe91-4876-8df6-3e73a9c3b9c2 req-9573b697-4137-4bdd-9c6d-787cb0e9ac72 tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 18f8e118-7b67-4ed5-9443-5fdf8a2c4c01 with Priority: HIGHEST for action security_group_rules [ 687.772813] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f8e118-7b67-4ed5-9443-5fdf8a2c4c01 with Priority: HIGHEST for action security_group_rules [ 687.773173] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18f8e118-7b67-4ed5-9443-5fdf8a2c4c01 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.773324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18f8e118-7b67-4ed5-9443-5fdf8a2c4c01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.773402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18f8e118-7b67-4ed5-9443-5fdf8a2c4c01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.773682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18f8e118-7b67-4ed5-9443-5fdf8a2c4c01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.773767] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18f8e118-7b67-4ed5-9443-5fdf8a2c4c01',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.923578] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: SUCCESS [ 687.923864] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.098978] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f5a9437b-365c-4cb9-8a27-d620cbb2087b None None] Enqueued Resource ID: 21d23612-5c0c-4b9c-b20d-5df608ae8ee4 with Priority: HIGHEST for action port [ 688.099271] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d23612-5c0c-4b9c-b20d-5df608ae8ee4 with Priority: HIGHEST for action port [ 688.099847] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-21d23612-5c0c-4b9c-b20d-5df608ae8ee4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.099983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21d23612-5c0c-4b9c-b20d-5df608ae8ee4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.100061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21d23612-5c0c-4b9c-b20d-5df608ae8ee4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.100311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21d23612-5c0c-4b9c-b20d-5df608ae8ee4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.100393] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d23612-5c0c-4b9c-b20d-5df608ae8ee4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.204047] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.204246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.204360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.204529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.204620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.204721] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 688.237677] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.237907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.237993] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.238664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.238886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.253983] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 688.299418] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.301563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.301563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.301563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.301563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.301563] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18f8e118-7b67-4ed5-9443-5fdf8a2c4c01 already deleted. [ 688.301563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18f8e118-7b67-4ed5-9443-5fdf8a2c4c01" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.607956] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21d23612-5c0c-4b9c-b20d-5df608ae8ee4 [ 688.608382] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.608607] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.608732] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.609071] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.609178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.609327] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21d23612-5c0c-4b9c-b20d-5df608ae8ee4 already deleted. [ 688.609442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21d23612-5c0c-4b9c-b20d-5df608ae8ee4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.833840] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3e910e26-ce7a-48ed-b3a3-71bc605d8c5a None None] Enqueued Resource ID: 7cc19b1a-1d8d-4f98-9c7e-2414adc7949f with Priority: HIGHEST for action port [ 688.834420] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc19b1a-1d8d-4f98-9c7e-2414adc7949f with Priority: HIGHEST for action port [ 688.834725] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc19b1a-1d8d-4f98-9c7e-2414adc7949f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.834863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc19b1a-1d8d-4f98-9c7e-2414adc7949f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.835146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc19b1a-1d8d-4f98-9c7e-2414adc7949f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.835190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc19b1a-1d8d-4f98-9c7e-2414adc7949f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.835268] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc19b1a-1d8d-4f98-9c7e-2414adc7949f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.242818] env[69360]: INFO networking_nsxv3.common.synchronization [req-be828dd9-f06a-4267-b660-1a75113835c1 req-b4b11802-25bc-40b5-8bcd-8723afe8e9ba tempest-ServersAdminTestJSON-963435758 tempest-ServersAdminTestJSON-963435758-project-member] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 689.242818] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGHEST for action security_group_members [ 689.243140] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.245165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.245996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.245996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.245996] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.245996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.246203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.246544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.246671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.246792] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.337032] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc19b1a-1d8d-4f98-9c7e-2414adc7949f [ 689.337456] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.337555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.337613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.337883] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.338009] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.338113] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc19b1a-1d8d-4f98-9c7e-2414adc7949f already deleted. [ 689.338216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc19b1a-1d8d-4f98-9c7e-2414adc7949f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.753107] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.753107] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.753107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.753107] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf is going to be updated. [ 689.783897] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.784067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.784139] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.784561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.784561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.796689] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: IN_PROGRESS for 2s [ 690.266097] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 690.266634] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.266634] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.266698] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.266894] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.267043] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.267107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.267286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.267371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.267468] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.772721] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.772721] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.772721] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 690.803330] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.809031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.809031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.809031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.809031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.828666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 691.067117] env[69360]: INFO networking_nsxv3.common.synchronization [req-62cae6eb-2de7-4575-aeb3-19deaceac2e5 req-da3ca853-a6ca-409f-9e8c-f6c1a4d3bc54 tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 691.067117] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 691.067117] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.067117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.067117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.067860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.068071] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f2b95c-1e8c-4157-8475-fd4e98ef41e2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.325240] env[69360]: INFO networking_nsxv3.common.synchronization [None req-36b4f202-2103-4329-960e-9c2833d3d5b2 None None] Enqueued Resource ID: a67cf341-2270-4d16-b904-8e75082197d2 with Priority: HIGHEST for action port [ 691.325521] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67cf341-2270-4d16-b904-8e75082197d2 with Priority: HIGHEST for action port [ 691.326630] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67cf341-2270-4d16-b904-8e75082197d2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.326630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67cf341-2270-4d16-b904-8e75082197d2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.326630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67cf341-2270-4d16-b904-8e75082197d2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.326918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67cf341-2270-4d16-b904-8e75082197d2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.326918] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67cf341-2270-4d16-b904-8e75082197d2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.576909] env[69360]: INFO networking_nsxv3.common.synchronization [req-2edfdf16-723f-43a5-9ffd-8bfd161fbbb4 req-ba491c15-95e1-47d3-8ee9-93c36b26030b tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 691.577459] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 691.577811] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.578113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.592741] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.592741] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 already deleted. [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.592741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.592741] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f2b95c-1e8c-4157-8475-fd4e98ef41e2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.807492] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a55b27fd-fe87-4592-84d0-620efe1b57cf in Status: SUCCESS [ 691.807678] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf deletion is rescheduled due to dependency. [ 691.807796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.831342] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a67cf341-2270-4d16-b904-8e75082197d2 [ 691.831672] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.831824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.831977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.832236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.832346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.832465] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a67cf341-2270-4d16-b904-8e75082197d2 already deleted. [ 691.832558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67cf341-2270-4d16-b904-8e75082197d2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.963818] env[69360]: INFO networking_nsxv3.common.synchronization [None req-fbd6ae93-435a-44ca-b370-de66075a5fd7 None None] Enqueued Resource ID: 78735ab2-1b57-438f-a6de-c3b96c0541ca with Priority: HIGHEST for action port [ 691.965688] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78735ab2-1b57-438f-a6de-c3b96c0541ca with Priority: HIGHEST for action port [ 691.965688] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-78735ab2-1b57-438f-a6de-c3b96c0541ca taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.965688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78735ab2-1b57-438f-a6de-c3b96c0541ca" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.965688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78735ab2-1b57-438f-a6de-c3b96c0541ca" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.965688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78735ab2-1b57-438f-a6de-c3b96c0541ca" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.965688] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78735ab2-1b57-438f-a6de-c3b96c0541ca',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.117222] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.117382] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.117437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.117647] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.117738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.117834] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 already deleted. [ 692.117910] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.267521] env[69360]: INFO networking_nsxv3.common.synchronization [req-3ca173c9-9c36-4290-ab08-de12193f618e req-46ff86b3-37b2-41c5-bc1f-4dd4a7e36bf9 tempest-SecurityGroupRulesTestJSON-738535824 tempest-SecurityGroupRulesTestJSON-738535824-project-member] Enqueued Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 692.268151] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 with Priority: HIGHEST for action security_group_rules [ 692.268491] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.268723] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.268819] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.269099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.269215] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78f2b95c-1e8c-4157-8475-fd4e98ef41e2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.467068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78735ab2-1b57-438f-a6de-c3b96c0541ca [ 692.467365] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.467480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.467558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.467770] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.468220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.469195] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78735ab2-1b57-438f-a6de-c3b96c0541ca already deleted. [ 692.469195] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78735ab2-1b57-438f-a6de-c3b96c0541ca" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.487303] env[69360]: INFO networking_nsxv3.common.synchronization [None req-fc3a2278-0f9e-4894-abb4-0e912de706c2 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 692.487954] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 692.488320] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.488454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.488525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.488784] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.488912] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.605899] env[69360]: INFO networking_nsxv3.common.synchronization [None req-21e8befd-a549-4945-bbbc-35aa90094495 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 692.605899] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 692.606630] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.606630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.788771] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.788771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.789276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.790182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.790375] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.790375] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78f2b95c-1e8c-4157-8475-fd4e98ef41e2 already deleted. [ 692.790532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78f2b95c-1e8c-4157-8475-fd4e98ef41e2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.838760] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 692.838760] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 deletion is rescheduled due to dependency. [ 692.838760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.015028] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.015028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.015028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.015237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.015329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.015370] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 already deleted. [ 693.015466] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.015635] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.015789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.015877] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.543601] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.543601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.543601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.543601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.543601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.543601] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 already deleted. [ 693.543601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.994829] env[69360]: INFO networking_nsxv3.common.synchronization [None req-62cb0035-c093-4f16-a19b-55f794d9eea2 None None] Enqueued Resource ID: 181cc01a-592d-4286-ab55-8ea2e1ebd59d with Priority: HIGHEST for action port [ 694.995301] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 181cc01a-592d-4286-ab55-8ea2e1ebd59d with Priority: HIGHEST for action port [ 694.995301] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-181cc01a-592d-4286-ab55-8ea2e1ebd59d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.995404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-181cc01a-592d-4286-ab55-8ea2e1ebd59d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.995433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-181cc01a-592d-4286-ab55-8ea2e1ebd59d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.995686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-181cc01a-592d-4286-ab55-8ea2e1ebd59d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.995763] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('181cc01a-592d-4286-ab55-8ea2e1ebd59d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.498714] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 181cc01a-592d-4286-ab55-8ea2e1ebd59d [ 695.500247] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.500247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.500247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.500247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.500247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.500247] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:181cc01a-592d-4286-ab55-8ea2e1ebd59d already deleted. [ 695.500247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-181cc01a-592d-4286-ab55-8ea2e1ebd59d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.536957] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6ac545b5-3ebd-4b1d-a92a-2d0e84a4f5f0 None None] Enqueued Resource ID: 378454e7-9d7d-4feb-8a1e-173c70b6ffd7 with Priority: HIGHEST for action port [ 696.537737] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 378454e7-9d7d-4feb-8a1e-173c70b6ffd7 with Priority: HIGHEST for action port [ 696.538345] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-378454e7-9d7d-4feb-8a1e-173c70b6ffd7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.538522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-378454e7-9d7d-4feb-8a1e-173c70b6ffd7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.538551] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-378454e7-9d7d-4feb-8a1e-173c70b6ffd7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.539061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-378454e7-9d7d-4feb-8a1e-173c70b6ffd7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.539155] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('378454e7-9d7d-4feb-8a1e-173c70b6ffd7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.565825] env[69360]: INFO networking_nsxv3.common.synchronization [req-8034ed55-f905-44d0-a144-125588b682dc req-225070ed-33d5-4b88-a8d9-d679a648eaa3 tempest-ServerTagsTestJSON-810630044 tempest-ServerTagsTestJSON-810630044-project-member] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 696.565825] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGHEST for action security_group_members [ 696.566509] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.566652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.566729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.567856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.568020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.568811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.568811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.568811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.568811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.568811] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.043348] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 378454e7-9d7d-4feb-8a1e-173c70b6ffd7 [ 697.043348] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.043348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.043348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.043348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.043348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.043591] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:378454e7-9d7d-4feb-8a1e-173c70b6ffd7 already deleted. [ 697.043591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-378454e7-9d7d-4feb-8a1e-173c70b6ffd7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.072569] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.073042] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.073042] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.073246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.074406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.074406] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.074406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.074406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.074406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.074406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.074406] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b is going to be updated. [ 697.106330] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.106538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.106591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.107297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.107297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.118830] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: IN_PROGRESS for 2s [ 698.250360] env[69360]: INFO networking_nsxv3.common.synchronization [req-edcd6451-8e2d-46d2-bbd3-5224f740ef2e req-9c061dc7-3922-435c-bf22-7227cb7803c7 tempest-ServerMetadataTestJSON-698858 tempest-ServerMetadataTestJSON-698858-project-member] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 698.250981] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 698.251336] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.251461] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.251526] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.251783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.252444] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.252601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.252906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.253035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.253188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.253313] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.758524] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.758524] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.758524] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbde8810-49af-4182-a254-894a61c0037e already deleted. [ 698.758524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.858252] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.858252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-573" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.858252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-573" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.858252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-573" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.858252] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.858252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.859035] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.860712] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.861081] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.861582] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.864416] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.864416] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.864416] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.864416] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 698.864416] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.864416] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.885688] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.885688] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 698.885798] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.886055] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-573" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.886307] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-91a80978-9bf2-4ee0-95e7-500f762bec77 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.887033] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.887033] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.887033] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.887033] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a80978-9bf2-4ee0-95e7-500f762bec77',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.131377] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: IN_PROGRESS for 4s [ 699.394111] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.394394] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.394490] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.394806] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.394964] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.395143] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 91a80978-9bf2-4ee0-95e7-500f762bec77 not found, creating... [ 699.395410] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.395577] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.395687] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.395910] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.396080] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.399708] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.399708] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.399708] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.399708] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.399708] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.399708] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 91a80978-9bf2-4ee0-95e7-500f762bec77 is going to be created. [ 699.410798] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b38c2c81-48db-4bd2-a027-efc749d428c1 None None] Enqueued Resource ID: 1424520d-fb7c-4448-9a6b-2f91883cbad4 with Priority: HIGHEST for action port [ 699.411466] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1424520d-fb7c-4448-9a6b-2f91883cbad4 with Priority: HIGHEST for action port [ 699.411826] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1424520d-fb7c-4448-9a6b-2f91883cbad4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.413028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1424520d-fb7c-4448-9a6b-2f91883cbad4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.413028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1424520d-fb7c-4448-9a6b-2f91883cbad4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.413028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1424520d-fb7c-4448-9a6b-2f91883cbad4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.413243] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1424520d-fb7c-4448-9a6b-2f91883cbad4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.419599] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.419798] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.419932] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.420228] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.420457] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.420690] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.916310] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1424520d-fb7c-4448-9a6b-2f91883cbad4 [ 699.916620] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.916733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.916766] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.916967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.917073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.917186] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1424520d-fb7c-4448-9a6b-2f91883cbad4 already deleted. [ 699.917260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1424520d-fb7c-4448-9a6b-2f91883cbad4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [req-edcd6451-8e2d-46d2-bbd3-5224f740ef2e req-7e0bc4a3-a7f1-4156-8022-2d34d2c4627b service nova] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_rules [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [req-edcd6451-8e2d-46d2-bbd3-5224f740ef2e req-7e0bc4a3-a7f1-4156-8022-2d34d2c4627b service nova] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [req-edcd6451-8e2d-46d2-bbd3-5224f740ef2e req-7e0bc4a3-a7f1-4156-8022-2d34d2c4627b service nova] Enqueued Resource ID: 91a80978-9bf2-4ee0-95e7-500f762bec77 with Priority: HIGHEST for action port [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_rules [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 700.472746] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a80978-9bf2-4ee0-95e7-500f762bec77 with Priority: HIGHEST for action port [ 700.473872] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.474199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.474658] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.475097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.475709] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.476913] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.477191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.477441] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.478078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.478078] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.478078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.478078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.478249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.478478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.478478] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.479185] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a80978-9bf2-4ee0-95e7-500f762bec77 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.479295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.479361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.479511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.479583] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a80978-9bf2-4ee0-95e7-500f762bec77',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.981099] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.982485] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.982665] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.983063] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91a80978-9bf2-4ee0-95e7-500f762bec77 with status ACTIVE [ 700.983280] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.983400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.983467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.983689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.984195] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.984195] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.986918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.987060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.987226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.987318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.987518] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.987622] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.987694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.987920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.987920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.988066] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91a80978-9bf2-4ee0-95e7-500f762bec77 is going to be updated. [ 701.013796] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.013796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.013962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.014099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.014267] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.014489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a80978-9bf2-4ee0-95e7-500f762bec77" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.143725] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b in Status: SUCCESS [ 701.143725] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b deletion is rescheduled due to dependency. [ 701.143725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.153822] env[69360]: INFO networking_nsxv3.common.synchronization [req-ca0e726a-37fd-405c-8640-e70420ab4daa req-97336018-d1aa-49f0-b361-832a28059e0d tempest-ServerPasswordTestJSON-287328885 tempest-ServerPasswordTestJSON-287328885-project-member] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 701.154378] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 701.154673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.154799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.154872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.156732] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.156920] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.157063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.157133] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.157307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.157395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.157498] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.484434] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.662114] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.662599] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.662736] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.663068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.663234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.663492] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.663611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.663676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.663891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.663918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.664013] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 already deleted. [ 701.665161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.991152] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.991152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.991152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.991152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.991152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.991152] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbde8810-49af-4182-a254-894a61c0037e is going to be created. [ 702.018620] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.018620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.018620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.018620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.018620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.031409] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: UNINITIALIZED for 2s [ 702.416287] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-694 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.416588] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-694" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.416744] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-694" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.417550] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-694" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.417879] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.418078] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.418211] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.418450] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.418679] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.418828] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.418952] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.419108] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.419223] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.419337] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.419445] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.419576] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.438414] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.438557] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.438760] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.440208] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-694" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.440208] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-975c2dda-8218-4379-9269-8b01752fffff taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.440377] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.440542] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.440827] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.440932] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975c2dda-8218-4379-9269-8b01752fffff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.943816] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.947155] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 975c2dda-8218-4379-9269-8b01752fffff not found, creating... [ 702.947155] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.947155] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.947590] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.947590] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.947590] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.948406] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.948833] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.949099] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 975c2dda-8218-4379-9269-8b01752fffff is going to be created. [ 702.975981] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.975981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.975981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.975981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.975981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.975981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.355110] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7751466c-d6c7-4bdc-89c7-90da7ba657f0 None None] Enqueued Resource ID: 1e185afd-f8b8-4dcd-903d-c4d8daa56616 with Priority: HIGHEST for action port [ 703.355110] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e185afd-f8b8-4dcd-903d-c4d8daa56616 with Priority: HIGHEST for action port [ 703.355110] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e185afd-f8b8-4dcd-903d-c4d8daa56616 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.355532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e185afd-f8b8-4dcd-903d-c4d8daa56616" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.356550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e185afd-f8b8-4dcd-903d-c4d8daa56616" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e185afd-f8b8-4dcd-903d-c4d8daa56616" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357111] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e185afd-f8b8-4dcd-903d-c4d8daa56616',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.384413] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ec82c22c-d62b-48a5-9f97-bd399f6b6eec None None] Enqueued Resource ID: f4aa3d83-4bb6-495e-a249-e265f3f6a7ee with Priority: HIGHEST for action port [ 703.387032] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aa3d83-4bb6-495e-a249-e265f3f6a7ee with Priority: HIGHEST for action port [ 703.387032] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4aa3d83-4bb6-495e-a249-e265f3f6a7ee taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.387032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4aa3d83-4bb6-495e-a249-e265f3f6a7ee" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.387032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4aa3d83-4bb6-495e-a249-e265f3f6a7ee" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.387032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4aa3d83-4bb6-495e-a249-e265f3f6a7ee" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.387032] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4aa3d83-4bb6-495e-a249-e265f3f6a7ee',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.861664] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e185afd-f8b8-4dcd-903d-c4d8daa56616 [ 703.861664] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.861911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.861911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.862416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.862416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.862416] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e185afd-f8b8-4dcd-903d-c4d8daa56616 already deleted. [ 703.862416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e185afd-f8b8-4dcd-903d-c4d8daa56616" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.892889] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4aa3d83-4bb6-495e-a249-e265f3f6a7ee [ 703.893160] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.893291] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.893362] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.893559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.893644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.893741] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4aa3d83-4bb6-495e-a249-e265f3f6a7ee already deleted. [ 703.893813] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4aa3d83-4bb6-495e-a249-e265f3f6a7ee" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.041693] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: SUCCESS [ 704.042031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.042194] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.042344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.042535] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.042652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.042722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.042865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.042944] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.043132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.043132] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.546549] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.546549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.546549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.547196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.547196] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.547196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.547196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.547385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.547385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.547385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.547517] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.547604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.547663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.547793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.549063] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.549063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.549063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.549515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.549515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.549515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.549515] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.034963] env[69360]: INFO networking_nsxv3.common.synchronization [None req-77242156-92a9-4b15-8e95-597483ab12ea None None] Enqueued Resource ID: f97df337-02a9-4622-a18c-277305cac8ff with Priority: HIGHEST for action port [ 705.035254] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f97df337-02a9-4622-a18c-277305cac8ff with Priority: HIGHEST for action port [ 705.035846] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-f97df337-02a9-4622-a18c-277305cac8ff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.035970] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f97df337-02a9-4622-a18c-277305cac8ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.036953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f97df337-02a9-4622-a18c-277305cac8ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.037596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f97df337-02a9-4622-a18c-277305cac8ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.038046] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f97df337-02a9-4622-a18c-277305cac8ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.055870] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbde8810-49af-4182-a254-894a61c0037e: rpc.has_security_group_logging(os_id): False [ 705.077815] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.077959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.078059] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.078285] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.078418] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.078649] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.078747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.078808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.078977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.079065] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.079249] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.081020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.081020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.084282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.084384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.084490] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbde8810-49af-4182-a254-894a61c0037e is going to be created. [ 705.154986] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.154986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.154986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.154986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.154986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.177971] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: IN_PROGRESS for 2s [ 705.274896] env[69360]: INFO networking_nsxv3.common.synchronization [req-ca0e726a-37fd-405c-8640-e70420ab4daa req-b2578806-8c08-434a-89e7-e9a44e3ce8c0 service nova] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_rules [ 705.275105] env[69360]: INFO networking_nsxv3.common.synchronization [req-ca0e726a-37fd-405c-8640-e70420ab4daa req-b2578806-8c08-434a-89e7-e9a44e3ce8c0 service nova] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 705.275289] env[69360]: INFO networking_nsxv3.common.synchronization [req-ca0e726a-37fd-405c-8640-e70420ab4daa req-b2578806-8c08-434a-89e7-e9a44e3ce8c0 service nova] Enqueued Resource ID: 975c2dda-8218-4379-9269-8b01752fffff with Priority: HIGHEST for action port [ 705.276032] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_rules [ 705.276032] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 705.276032] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975c2dda-8218-4379-9269-8b01752fffff with Priority: HIGHEST for action port [ 705.276768] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.277049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.277049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.277251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.277333] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.278946] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.279476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.279476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.279476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.279617] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.279617] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.279791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.279791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.279897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.280030] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.281173] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-975c2dda-8218-4379-9269-8b01752fffff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.281344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.281344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.281513] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.281684] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975c2dda-8218-4379-9269-8b01752fffff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.542539] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f97df337-02a9-4622-a18c-277305cac8ff [ 705.542539] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.542998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.543436] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f97df337-02a9-4622-a18c-277305cac8ff already deleted. [ 705.543436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f97df337-02a9-4622-a18c-277305cac8ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.780547] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.780976] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.784612] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.787087] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 975c2dda-8218-4379-9269-8b01752fffff with status ACTIVE [ 705.787292] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.787418] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.787481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.787687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.787866] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.788072] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.788072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.788718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.788718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.788718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.788718] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.788718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.788718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.789107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.789107] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 975c2dda-8218-4379-9269-8b01752fffff is going to be updated. [ 705.811731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.812245] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.812504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.812571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.812784] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.812959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-975c2dda-8218-4379-9269-8b01752fffff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.272029] env[69360]: INFO networking_nsxv3.common.synchronization [req-a054e73b-3097-4a8c-88a1-51c19c938e7e req-b5769077-4a86-410f-b11d-4cb991498334 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 706.272542] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 706.272916] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.273064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.273064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.273275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.273396] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.273492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.273544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.273693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.275128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.275487] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.288573] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.781163] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.794365] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.794365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.794365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.794365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.794365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.794365] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 is going to be created. [ 706.819793] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.819793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.819793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.820270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.820536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.833847] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: UNINITIALIZED for 2s [ 707.049669] env[69360]: INFO networking_nsxv3.common.synchronization [None req-cccdd9d4-3b37-421e-b456-2c777130b86f None None] Enqueued Resource ID: 4be2f45d-791f-4024-93be-12fc888c42ea with Priority: HIGHEST for action port [ 707.051316] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4be2f45d-791f-4024-93be-12fc888c42ea with Priority: HIGHEST for action port [ 707.051736] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4be2f45d-791f-4024-93be-12fc888c42ea taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.052480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4be2f45d-791f-4024-93be-12fc888c42ea" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.052480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4be2f45d-791f-4024-93be-12fc888c42ea" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.052480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4be2f45d-791f-4024-93be-12fc888c42ea" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.052480] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4be2f45d-791f-4024-93be-12fc888c42ea',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.126059] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.126059] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.126312] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.126449] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.126708] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.126868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.126989] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.127381] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.127446] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.127633] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.127750] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.127867] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.127976] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.128104] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 707.128212] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.128344] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.149871] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.151092] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 707.151092] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.151092] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-364" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.151092] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-df0ab2ea-5a93-4792-b937-b8327787a7b4 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.151092] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.151092] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.151406] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.151810] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ab2ea-5a93-4792-b937-b8327787a7b4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.198899] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: SUCCESS [ 707.199153] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.225913] env[69360]: INFO networking_nsxv3.common.synchronization [None req-e4032fc9-b41d-4948-b57d-2d3995f9a860 tempest-ServersTestFqdnHostnames-2115646556 tempest-ServersTestFqdnHostnames-2115646556-project-member] Enqueued Resource ID: bc7f4915-e251-49a9-94c9-190fe17800fe with Priority: HIGHEST for action security_group_rules [ 707.227134] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7f4915-e251-49a9-94c9-190fe17800fe with Priority: HIGHEST for action security_group_rules [ 707.227242] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7f4915-e251-49a9-94c9-190fe17800fe taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.227370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.227437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.227724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.227808] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7f4915-e251-49a9-94c9-190fe17800fe',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.284242] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.385549] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5ae40061-8857-4b63-adcd-5acd1e0a72b9 None None] Enqueued Resource ID: 6a9eca73-9768-4af9-818b-bb87ae57cacf with Priority: HIGHEST for action port [ 707.385549] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a9eca73-9768-4af9-818b-bb87ae57cacf with Priority: HIGHEST for action port [ 707.385930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a9eca73-9768-4af9-818b-bb87ae57cacf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.386455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a9eca73-9768-4af9-818b-bb87ae57cacf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.386539] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a9eca73-9768-4af9-818b-bb87ae57cacf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.386834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a9eca73-9768-4af9-818b-bb87ae57cacf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.386924] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a9eca73-9768-4af9-818b-bb87ae57cacf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.403984] env[69360]: INFO networking_nsxv3.common.synchronization [None req-5d6ff314-e7cb-46fe-a6c7-1a07e9ca8fc9 tempest-ServersTestFqdnHostnames-2115646556 tempest-ServersTestFqdnHostnames-2115646556-project-member] Enqueued Resource ID: bc7f4915-e251-49a9-94c9-190fe17800fe with Priority: HIGHEST for action security_group_rules [ 707.404612] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7f4915-e251-49a9-94c9-190fe17800fe with Priority: HIGHEST for action security_group_rules [ 707.405882] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7f4915-e251-49a9-94c9-190fe17800fe taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.406021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.555586] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4be2f45d-791f-4024-93be-12fc888c42ea [ 707.555586] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.555586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.555586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.555586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.555586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.556104] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4be2f45d-791f-4024-93be-12fc888c42ea already deleted. [ 707.556278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4be2f45d-791f-4024-93be-12fc888c42ea" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.657349] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.657349] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port df0ab2ea-5a93-4792-b937-b8327787a7b4 not found, creating... [ 707.657349] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.657349] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.657703] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.657703] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.657703] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.657703] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.657703] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.657703] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 is going to be created. [ 707.682182] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.682494] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.682494] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.682753] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.682991] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.683247] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.763038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.763038] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7f4915-e251-49a9-94c9-190fe17800fe already deleted. [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.763038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.763038] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7f4915-e251-49a9-94c9-190fe17800fe',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.794034] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.794034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.794034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.794034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.794034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.794034] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 707.842813] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.843026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.843097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.843317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.843455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.850024] env[69360]: INFO networking_nsxv3.common.synchronization [None req-34e85f53-b058-49af-bf24-0ba9028d0ca2 tempest-ServersTestJSON-1126084006 tempest-ServersTestJSON-1126084006-project-member] Enqueued Resource ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 with Priority: HIGHEST for action security_group_rules [ 707.850329] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 with Priority: HIGHEST for action security_group_rules [ 707.850625] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.850745] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.850811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.851180] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.851180] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('624fab4e-3c37-48fc-b4a2-f93c3df23c27',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.853061] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 707.890732] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a9eca73-9768-4af9-818b-bb87ae57cacf [ 707.894354] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.894516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.894586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.894817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.894918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.895037] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a9eca73-9768-4af9-818b-bb87ae57cacf already deleted. [ 707.895123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a9eca73-9768-4af9-818b-bb87ae57cacf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.096924] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0964ff4a-3a82-48e9-ba76-bb02de9c9549 None None] Enqueued Resource ID: 7d7835dc-170e-4e55-ad26-dbd3255f2c1a with Priority: HIGHEST for action port [ 708.097227] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d7835dc-170e-4e55-ad26-dbd3255f2c1a with Priority: HIGHEST for action port [ 708.097821] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d7835dc-170e-4e55-ad26-dbd3255f2c1a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.097954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d7835dc-170e-4e55-ad26-dbd3255f2c1a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.098037] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d7835dc-170e-4e55-ad26-dbd3255f2c1a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.098294] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d7835dc-170e-4e55-ad26-dbd3255f2c1a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.098380] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d7835dc-170e-4e55-ad26-dbd3255f2c1a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.290318] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.290318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.290318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.290318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.290318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.290318] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7f4915-e251-49a9-94c9-190fe17800fe already deleted. [ 708.290318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7f4915-e251-49a9-94c9-190fe17800fe" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.377153] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.380719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.380719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.380719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.380719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.380719] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 already deleted. [ 708.380719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.512263] env[69360]: INFO networking_nsxv3.common.synchronization [None req-aa7652cb-6167-43e9-bd8f-bb95cb7eb4e6 tempest-ServersTestJSON-1126084006 tempest-ServersTestJSON-1126084006-project-member] Enqueued Resource ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 with Priority: HIGHEST for action security_group_rules [ 708.512263] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 with Priority: HIGHEST for action security_group_rules [ 708.512263] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.512263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.512263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.512263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.512263] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('624fab4e-3c37-48fc-b4a2-f93c3df23c27',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.595147] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6380c56e-6cb6-411f-8276-15fc3e80ac90 None None] Enqueued Resource ID: d3be715c-4e73-4615-837f-28d02e478aa8 with Priority: HIGHEST for action port [ 708.595664] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3be715c-4e73-4615-837f-28d02e478aa8 with Priority: HIGHEST for action port [ 708.595980] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3be715c-4e73-4615-837f-28d02e478aa8 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.596131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3be715c-4e73-4615-837f-28d02e478aa8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.600350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3be715c-4e73-4615-837f-28d02e478aa8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.600506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3be715c-4e73-4615-837f-28d02e478aa8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.600557] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3be715c-4e73-4615-837f-28d02e478aa8',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.602058] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d7835dc-170e-4e55-ad26-dbd3255f2c1a [ 708.602266] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.602391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.602455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.602664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.602728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.603161] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d7835dc-170e-4e55-ad26-dbd3255f2c1a already deleted. [ 708.603161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d7835dc-170e-4e55-ad26-dbd3255f2c1a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.845614] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: SUCCESS [ 708.846587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.846587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.846587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.847919] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.850661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.850914] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.851140] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.851230] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.851343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.851447] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [req-a054e73b-3097-4a8c-88a1-51c19c938e7e req-dc93eec7-4af0-4f3e-b8f2-f72ed7105227 service nova] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [req-a054e73b-3097-4a8c-88a1-51c19c938e7e req-dc93eec7-4af0-4f3e-b8f2-f72ed7105227 service nova] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [req-a054e73b-3097-4a8c-88a1-51c19c938e7e req-dc93eec7-4af0-4f3e-b8f2-f72ed7105227 service nova] Enqueued Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 708.983496] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 708.984189] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.984524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.984699] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.985149] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.985348] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.986607] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.988226] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.988497] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0ab2ea-5a93-4792-b937-b8327787a7b4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.988642] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.988710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.988941] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.989033] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ab2ea-5a93-4792-b937-b8327787a7b4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.034211] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.034392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.034471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.034682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.034775] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.034874] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 624fab4e-3c37-48fc-b4a2-f93c3df23c27 already deleted. [ 709.035136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-624fab4e-3c37-48fc-b4a2-f93c3df23c27" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.107868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3be715c-4e73-4615-837f-28d02e478aa8 [ 709.107868] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.107868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.107868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.107868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.107868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.107868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3be715c-4e73-4615-837f-28d02e478aa8 already deleted. [ 709.107868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3be715c-4e73-4615-837f-28d02e478aa8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.354762] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.355474] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.355591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.355954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.356197] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.356468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.356572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.356935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.359543] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.359543] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.359543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.359543] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.490648] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.490813] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.491377] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0ab2ea-5a93-4792-b937-b8327787a7b4 with status ACTIVE [ 709.491377] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.494771] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.494771] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.494771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.494771] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 is going to be updated. [ 709.522260] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.522414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.522501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.522695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.522834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.523019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.862639] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2703b410-f705-4fcc-9444-dcfc58a56134: rpc.has_security_group_logging(os_id): False [ 709.865977] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 709.866165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.866340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.866565] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.866754] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.866876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.866946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.867131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.867213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.867311] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.881808] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.882462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.882462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.883517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.883517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.883765] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.883915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.884051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.884326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.884452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.885028] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.885028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.885028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.885028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.885253] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.885454] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.885586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.885695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.885880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.886015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.886151] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 is going to be created. [ 709.956297] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.956458] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.956538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.956785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.956969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.968149] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: IN_PROGRESS for 2s [ 710.369206] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.873102] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.238185] env[69360]: INFO networking_nsxv3.common.synchronization [None req-9b393e5f-23bc-43dd-8bcd-269c52eb1298 None None] Enqueued Resource ID: 0999d2ff-b1d9-4d4a-b173-cc31acb3dff8 with Priority: HIGHEST for action port [ 711.238799] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0999d2ff-b1d9-4d4a-b173-cc31acb3dff8 with Priority: HIGHEST for action port [ 711.239139] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-0999d2ff-b1d9-4d4a-b173-cc31acb3dff8 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.239303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0999d2ff-b1d9-4d4a-b173-cc31acb3dff8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.239376] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0999d2ff-b1d9-4d4a-b173-cc31acb3dff8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.239655] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0999d2ff-b1d9-4d4a-b173-cc31acb3dff8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.239735] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0999d2ff-b1d9-4d4a-b173-cc31acb3dff8',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.375635] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.375975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.375975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.376108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.376189] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.376294] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 711.407287] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.407287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.407287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.407522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.407642] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.418016] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 711.748964] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0999d2ff-b1d9-4d4a-b173-cc31acb3dff8 [ 711.748964] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.748964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.748964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.748964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.748964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.748964] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0999d2ff-b1d9-4d4a-b173-cc31acb3dff8 already deleted. [ 711.748964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0999d2ff-b1d9-4d4a-b173-cc31acb3dff8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.985597] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: SUCCESS [ 711.985972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.430937] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 713.431311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.432358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.432657] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.432873] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.433046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.433829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.434078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.434173] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.434272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.434367] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.937113] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.937265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.937314] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.937542] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.937716] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.937822] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.937880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.938049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.938169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.938309] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.938482] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.938569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.938618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.938809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.942252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.942378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.942449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.942651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.942761] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.942849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.942944] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.445926] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 714.470238] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470238] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470238] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470697] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470697] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 714.545218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.545391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.545442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.549072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.549072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.566304] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 716.239518] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 716.239762] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 716.584095] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 716.584391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.876844] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 716.877014] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 716.877617] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 716.877758] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 716.880910] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.881135] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.881263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.881498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.881699] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.881839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.881935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.882148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.882319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.882319] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.887021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.887021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.887021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.887021] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.963739] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 716.963943] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 716.964097] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_rules [ 716.964240] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 716.964386] env[69360]: INFO networking_nsxv3.common.synchronization [req-82f9d202-1dae-470a-be99-1fa55d85868b req-bbd92953-911b-469c-8db0-8b97ab5db54c tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 716.965294] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 716.965294] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_rules [ 716.965516] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 716.965670] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 716.965822] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 716.966252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.966398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.966534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.967174] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.967319] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.968267] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.968503] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.968790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.972276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.972276] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.972276] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0ab2ea-5a93-4792-b937-b8327787a7b4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.972276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.972276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.972276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.972276] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ab2ea-5a93-4792-b937-b8327787a7b4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.972276] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.972276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.973375] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.973468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.334952] env[69360]: INFO networking_nsxv3.common.synchronization [None req-932c9225-fb71-4d58-9b0c-febdfa169cea None None] Enqueued Resource ID: 7cc17532-ce4b-4980-af32-2dfca9a044d7 with Priority: HIGHEST for action port [ 717.334952] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cc17532-ce4b-4980-af32-2dfca9a044d7 with Priority: HIGHEST for action port [ 717.334952] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cc17532-ce4b-4980-af32-2dfca9a044d7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.334952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cc17532-ce4b-4980-af32-2dfca9a044d7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.335392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cc17532-ce4b-4980-af32-2dfca9a044d7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.335392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cc17532-ce4b-4980-af32-2dfca9a044d7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.335392] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cc17532-ce4b-4980-af32-2dfca9a044d7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.371209] env[69360]: INFO networking_nsxv3.common.synchronization [req-b4416836-0f76-4b31-aa99-b0fec3a75acb req-9cbb4c36-c02b-49ae-9888-6e10a6b9b9f7 tempest-ServerMetadataTestJSON-698858 tempest-ServerMetadataTestJSON-698858-project-member] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 717.371723] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGHEST for action security_group_members [ 717.372863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.372863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.372863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.372863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.372863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.372863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.372863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.373191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.373191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.373191] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.389335] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.389335] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.474854] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.477839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.478041] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0ab2ea-5a93-4792-b937-b8327787a7b4 with status ACTIVE [ 717.478259] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.478385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.478448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.478669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.478776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.478966] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.479078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.479143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.479296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.479370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.479544] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.479632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.479847] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.479847] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.479997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.479997] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 is going to be updated. [ 717.482909] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.482909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.502988] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.503235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.503331] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.503552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.504257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.504257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.838321] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cc17532-ce4b-4980-af32-2dfca9a044d7 [ 717.838558] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.838696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.838765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.839142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.839142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.839142] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cc17532-ce4b-4980-af32-2dfca9a044d7 already deleted. [ 717.839264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cc17532-ce4b-4980-af32-2dfca9a044d7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.875232] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.875466] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.875534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.875756] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.875841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.876078] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.876178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.876238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.876399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.876467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.876559] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbde8810-49af-4182-a254-894a61c0037e is going to be updated. [ 717.890763] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.893331] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.910261] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.910406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.910488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.910740] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.910887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.923650] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: IN_PROGRESS for 2s [ 718.398695] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.398695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.398695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.398695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.398695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.398695] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 718.400773] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.400869] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.400979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.401191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.401311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.401408] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be created. [ 718.441022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.441022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.441022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.441022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.441022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.447663] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.447856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.447895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.448661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.448661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.455023] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: UNINITIALIZED for 2s [ 718.459127] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 718.523597] env[69360]: INFO networking_nsxv3.common.synchronization [req-5256b69c-c957-4645-bf1f-f7ae1efeab28 req-0dbe3c86-cb5e-4022-afb1-07c3fa3c7f08 tempest-ServerPasswordTestJSON-287328885 tempest-ServerPasswordTestJSON-287328885-project-member] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 718.524312] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGHEST for action security_group_members [ 718.524625] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.524751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.524857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.525086] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.525264] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.525368] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.525428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.525786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.525786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.525786] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.030245] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.030482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.030482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.030837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.031106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.031939] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.032081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.032161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.032476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.032573] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.032651] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 is going to be updated. [ 719.066841] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.067535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.067535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.067535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.067535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.078185] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: IN_PROGRESS for 2s [ 719.100176] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b1a1b753-79ab-4d81-9c4e-1628662a2a2d tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 719.100933] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 719.102138] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.102537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.102700] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.103410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.103533] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.616438] env[69360]: INFO networking_nsxv3.common.synchronization [None req-ad00dc52-6179-4b21-95e8-34747c04218b tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 719.616914] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 719.617333] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.617333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.624462] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.624635] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.624682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.624979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.624979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.625093] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 already deleted. [ 719.625142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.625277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.625427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.625505] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.938453] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbde8810-49af-4182-a254-894a61c0037e in Status: SUCCESS [ 719.938629] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbde8810-49af-4182-a254-894a61c0037e deletion is rescheduled due to dependency. [ 719.938741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.023059] env[69360]: INFO networking_nsxv3.common.synchronization [None req-33c5b373-a3b4-4241-a6c1-1c87ebd395b1 None None] Enqueued Resource ID: d1307387-e5ce-492c-bd88-fcfe48816c1c with Priority: HIGHEST for action port [ 720.024345] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1307387-e5ce-492c-bd88-fcfe48816c1c with Priority: HIGHEST for action port [ 720.025394] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1307387-e5ce-492c-bd88-fcfe48816c1c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.025924] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1307387-e5ce-492c-bd88-fcfe48816c1c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.026064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1307387-e5ce-492c-bd88-fcfe48816c1c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.028146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1307387-e5ce-492c-bd88-fcfe48816c1c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.028146] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1307387-e5ce-492c-bd88-fcfe48816c1c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.151172] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.151172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.151172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.151172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.151172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.151172] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 already deleted. [ 720.151172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.467619] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 720.467619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.467619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.467619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.468190] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.468384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.468478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.468667] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.468789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.468908] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.470503] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: SUCCESS [ 720.470733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.471108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.471372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.471575] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.471661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.471703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.471974] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.471974] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.472131] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.529571] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1307387-e5ce-492c-bd88-fcfe48816c1c [ 720.529919] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.530020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.530020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.530244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.530339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.530439] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1307387-e5ce-492c-bd88-fcfe48816c1c already deleted. [ 720.530522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1307387-e5ce-492c-bd88-fcfe48816c1c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.973907] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.975236] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.089223] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2703b410-f705-4fcc-9444-dcfc58a56134 in Status: SUCCESS [ 721.089511] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 deletion is rescheduled due to dependency. [ 721.089701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.476907] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.483652] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.985532] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.985804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.986046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.986250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.986423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.986486] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 721.987761] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.987863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.987906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.988081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.988167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.988254] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be updated. [ 722.046138] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.046319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.046357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.046615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.046704] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.048560] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.048856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.048856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.048959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.049084] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.059237] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 722.071290] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: IN_PROGRESS for 2s [ 722.777097] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 722.777261] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 722.777398] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 722.778043] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 722.780227] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 722.780227] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 722.780227] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c910bfc4-5933-4680-93f1-88558614fcff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.780227] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.780227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.780227] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.781103] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.781251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.781523] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.781700] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.839158] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 722.839363] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 722.839527] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_rules [ 722.839658] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 722.839784] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_rules [ 722.839934] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 722.840076] env[69360]: INFO networking_nsxv3.common.synchronization [req-86c7d08d-fbe7-4524-ab3d-b1fbb2688963 req-f6b13326-a789-4599-bd4c-aed53adb348a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 722.840878] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_rules [ 722.840878] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_rules [ 722.840878] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 722.841075] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 with Priority: HIGHEST for action port [ 722.841106] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_rules [ 722.841252] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 722.841252] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 722.841523] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.841639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.842437] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c910bfc4-5933-4680-93f1-88558614fcff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.842437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.842437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.842693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.842693] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.843977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.843977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.843977] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0ab2ea-5a93-4792-b937-b8327787a7b4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.843977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.844170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.844258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.844317] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ab2ea-5a93-4792-b937-b8327787a7b4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.846265] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.846780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.846780] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.846780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.846780] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c910bfc4-5933-4680-93f1-88558614fcff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.846933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.286050] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.348787] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0ab2ea-5a93-4792-b937-b8327787a7b4 with status ACTIVE [ 723.349152] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.349926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.350042] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.350348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.350488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.350731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.350845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.350911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.351137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.351242] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.351483] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.351644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.351730] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.352046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.352046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.353188] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0ab2ea-5a93-4792-b937-b8327787a7b4 is going to be updated. [ 723.354456] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c910bfc4-5933-4680-93f1-88558614fcff taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.354552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.378386] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.378594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.378594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.378811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.378957] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.379138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0ab2ea-5a93-4792-b937-b8327787a7b4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.788818] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.070666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 724.070763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.071019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.071147] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.071584] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.071584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.071584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.071747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.071747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.071842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.071930] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.073886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.074074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.074243] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.074351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.074412] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.074552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.074653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.075998] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.085268] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: SUCCESS [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.085268] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.085268] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.085268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.085845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.085845] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.085845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.085845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.085845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.086076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.086076] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.296023] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.296023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.296023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.296023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.296023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.296023] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c910bfc4-5933-4680-93f1-88558614fcff is going to be created. [ 724.321180] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.321329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.321398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.321615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.321779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.336592] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c910bfc4-5933-4680-93f1-88558614fcff in Status: UNINITIALIZED for 2s [ 724.577278] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.577423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.584097] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.587498] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.589231] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.086592] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.091246] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de57d4c5-7625-4bc3-9bd5-71d03e3e576c: rpc.has_security_group_logging(os_id): False [ 725.092554] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.111876] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.112153] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.112295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.112534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.112802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.113201] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.113201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.113201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.113351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.113503] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.113627] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be created. [ 725.183123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.183282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.183282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.184025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.184025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.199361] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: IN_PROGRESS for 2s [ 725.591339] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.591339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.591339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.591339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.591339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.591339] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 725.596830] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.596830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.596830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.596830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.596830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.596830] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be updated. [ 725.622658] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.622815] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.622891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.623718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.623952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.625789] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.626061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.626061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.626216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.626418] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.637093] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 725.637823] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: IN_PROGRESS for 2s [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [req-601e8c8f-7848-449b-9807-239b90966e66 req-69cd22ed-c81d-4677-adae-1a423fffcc73 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [req-601e8c8f-7848-449b-9807-239b90966e66 req-69cd22ed-c81d-4677-adae-1a423fffcc73 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [req-601e8c8f-7848-449b-9807-239b90966e66 req-69cd22ed-c81d-4677-adae-1a423fffcc73 tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c910bfc4-5933-4680-93f1-88558614fcff with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c with Priority: HIGHEST for action security_group_members [ 725.707095] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.707095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.707931] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c910bfc4-5933-4680-93f1-88558614fcff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.708210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.708496] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.708684] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.344172] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c910bfc4-5933-4680-93f1-88558614fcff in Status: SUCCESS [ 726.344449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.344762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.344998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.345205] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.345318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.345385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.345544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.345626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.345728] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.851317] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.851609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.851609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.851815] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.851879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.852270] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.852417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.852493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.852687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.852787] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.852896] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c910bfc4-5933-4680-93f1-88558614fcff is going to be deleted. [ 726.893930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.894183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.894313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.894589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.894738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.894905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.895129] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.896328] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.896569] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.897122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.897122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.897122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.897330] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.897388] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.216234] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: SUCCESS [ 727.217701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.217701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.217901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.218135] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.406903] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.407304] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.408907] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.408907] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c910bfc4-5933-4680-93f1-88558614fcff already deleted. [ 727.408907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.408907] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.412082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.412082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.412082] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.412082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.412082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.412265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.412402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.412540] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.651068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c in Status: SUCCESS [ 727.651309] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.652080] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 727.652255] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.652414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.652624] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.652802] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.652921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.652977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.653159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.653311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.653358] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.657250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.657483] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.657674] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.657798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.657862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.658305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.658305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.658305] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.741411] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.741553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.741623] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.741854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.742012] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.742329] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be deleted. [ 727.794500] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.794725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.794808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.795053] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.795148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.795335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.916526] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c910bfc4-5933-4680-93f1-88558614fcff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.917261] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.917423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.917466] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.917663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.917844] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.918083] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.920131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.920131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.920131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.920131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.920131] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c910bfc4-5933-4680-93f1-88558614fcff already deleted. [ 727.920131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.163296] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.163296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.163296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.164015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.164015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.164015] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.164015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.164576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.164576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.164576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.164576] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c is going to be deleted. [ 728.166645] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.204022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.204022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.204022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.204022] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de57d4c5-7625-4bc3-9bd5-71d03e3e576c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.419597] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c910bfc4-5933-4680-93f1-88558614fcff: rpc.has_security_group_logging(os_id): False [ 728.440409] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.442010] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.442010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.442010] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c910bfc4-5933-4680-93f1-88558614fcff is going to be created. [ 728.466013] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff], does not exist path=[/infra/domains/default/groups/c910bfc4-5933-4680-93f1-88558614fcff]."\n}' [ 728.466204] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c910bfc4-5933-4680-93f1-88558614fcff failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff [ 728.466332] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 728.498541] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.498682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.498682] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.498973] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.499798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.501038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.501745] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.501851] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.502104] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.502191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.502418] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.502574] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.502574] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.502830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.502830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.502919] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c910bfc4-5933-4680-93f1-88558614fcff is going to be created. [ 728.524225] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff], does not exist path=[/infra/domains/default/groups/c910bfc4-5933-4680-93f1-88558614fcff]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff [ 728.524387] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c910bfc4-5933-4680-93f1-88558614fcff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.524910] env[69360]: Traceback (most recent call last): [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 728.525028] env[69360]: return func(*args, **kwargs) [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 728.525028] env[69360]: res.raise_for_status() [ 728.525028] env[69360]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 728.525028] env[69360]: raise HTTPError(http_error_msg, response=self) [ 728.525028] env[69360]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff [ 728.525028] env[69360]: During handling of the above exception, another exception occurred: [ 728.525028] env[69360]: Traceback (most recent call last): [ 728.525028] env[69360]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 728.525028] env[69360]: listener.cb(fileno) [ 728.525028] env[69360]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 728.525028] env[69360]: result = function(*args, **kwargs) [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 728.525028] env[69360]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 728.525028] env[69360]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 728.525028] env[69360]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 728.525028] env[69360]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 728.525028] env[69360]: res.raise_for_status() [ 728.525028] env[69360]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 728.525028] env[69360]: raise HTTPError(http_error_msg, response=self) [ 728.525028] env[69360]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c910bfc4-5933-4680-93f1-88558614fcff [ 728.525028] env[69360]: Removing descriptor: 13 [ 728.669874] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.710967] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.710967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.710967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.710967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.710967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.710967] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.711947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.711947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.711947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.711947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.711947] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de57d4c5-7625-4bc3-9bd5-71d03e3e576c already deleted. [ 728.711947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de57d4c5-7625-4bc3-9bd5-71d03e3e576c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.175282] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.175282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.175282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.175282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.175282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.175282] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 729.226652] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.227022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.227022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.228947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.228947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.238780] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 730.708138] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 730.708138] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 731.253489] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 731.253824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.254092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.254431] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.254641] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.254767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.254834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.255015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.255104] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.255198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.255361] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.255443] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.255504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.255648] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.255784] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.255878] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.255940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.257293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.257597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.257738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.257799] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.258713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.259031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.259228] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.259408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.259521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.259727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.259811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.259906] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.766194] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 731.766194] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.786391] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.786900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.786900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.788351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.808404] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.808547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.808639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.808854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.808991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.809151] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.810072] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.810072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.810488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.810488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.810488] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 731.887048] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.887048] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.887048] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.887354] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.887354] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.908375] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 732.266792] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.768292] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.768637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.768637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.768767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.768861] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.768981] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 732.803736] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.805570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.805570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.805570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.805570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.818017] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 732.890769] env[69360]: INFO networking_nsxv3.common.synchronization [None req-981026c6-c131-451a-9fb5-ee1e8b5bcbeb None None] Enqueued Resource ID: a7b0e446-0a37-498e-a2bc-ad08566897e9 with Priority: HIGHEST for action port [ 732.891415] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b0e446-0a37-498e-a2bc-ad08566897e9 with Priority: HIGHEST for action port [ 732.892456] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b0e446-0a37-498e-a2bc-ad08566897e9 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.892707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b0e446-0a37-498e-a2bc-ad08566897e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.892707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b0e446-0a37-498e-a2bc-ad08566897e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.893495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b0e446-0a37-498e-a2bc-ad08566897e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.893495] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b0e446-0a37-498e-a2bc-ad08566897e9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.396653] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b0e446-0a37-498e-a2bc-ad08566897e9 [ 733.396653] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.396653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.396653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.396653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.396653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.396653] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b0e446-0a37-498e-a2bc-ad08566897e9 already deleted. [ 733.396653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b0e446-0a37-498e-a2bc-ad08566897e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.934413] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 733.934413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.934413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.934413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.934413] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.438229] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.438462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.828387] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 734.828811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.828811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.829076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.829290] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.829429] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.829491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.830087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.830087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.830087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.830087] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.988471] env[69360]: INFO networking_nsxv3.common.synchronization [req-877216f0-a699-42aa-99bb-4a741dc9bd1b req-45653a3b-9bdb-4012-b5ce-de290726b070 tempest-ServerRescueTestJSON-1132992793 tempest-ServerRescueTestJSON-1132992793-project-member] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 734.989052] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 734.989390] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.989527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.989598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.989933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.991779] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.991972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.992098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.992321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.992488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.992658] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.077408] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0cb6cc95-e159-4abd-8cb2-f1c02cbc1aaa None None] Enqueued Resource ID: 8b0faf36-a917-4119-81f2-af7694d22ea2 with Priority: HIGHEST for action port [ 735.079680] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b0faf36-a917-4119-81f2-af7694d22ea2 with Priority: HIGHEST for action port [ 735.079680] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b0faf36-a917-4119-81f2-af7694d22ea2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.079867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b0faf36-a917-4119-81f2-af7694d22ea2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.080100] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b0faf36-a917-4119-81f2-af7694d22ea2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.080287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b0faf36-a917-4119-81f2-af7694d22ea2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.080911] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b0faf36-a917-4119-81f2-af7694d22ea2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.332930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.333143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.333218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.333438] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.333609] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.333713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.333829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.333922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.334017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.334121] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.334289] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.334388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.334448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.334594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.334732] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.334839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.334869] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.335016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.335093] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.335175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.335265] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.391967] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-366 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.392212] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-366" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.392338] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-366" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.392681] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-366" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.392977] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.393144] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.393239] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.393460] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.393607] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.393818] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.393935] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.394059] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.394169] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.394306] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.394515] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.394588] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.417785] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.418624] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.418624] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.418624] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-366" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.418624] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.418828] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.418870] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.419649] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.419649] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.494734] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.494957] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.495096] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.495593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.495593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.495813] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.495959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.496089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.496311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.496431] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.496579] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf already deleted. [ 735.496720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.583645] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b0faf36-a917-4119-81f2-af7694d22ea2 [ 735.583863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.583991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.584058] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.584276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.584359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.584461] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b0faf36-a917-4119-81f2-af7694d22ea2 already deleted. [ 735.584548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b0faf36-a917-4119-81f2-af7694d22ea2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.837794] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3694c3f2-85a3-493d-8c83-767e017321ab: rpc.has_security_group_logging(os_id): False [ 735.857183] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.857341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.857415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.857692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.857761] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.858036] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.858131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.858131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.858279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.858364] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.858545] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.858643] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.858707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.858848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.858926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.859151] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.859278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.859334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.859479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.859555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.859641] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 735.924462] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.924751] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.924906] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.925220] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.925450] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.925649] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c not found, creating... [ 735.925935] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.926141] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.926315] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.926505] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.926648] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.927305] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.927305] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.927305] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.927628] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.927628] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.927732] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c is going to be created. [ 735.929842] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.930011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.930011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.930158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.930300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.953020] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.953330] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.953492] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.953828] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.954134] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.954404] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.956312] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 736.751322] env[69360]: INFO networking_nsxv3.common.synchronization [req-877216f0-a699-42aa-99bb-4a741dc9bd1b req-5ea282eb-a318-4de1-be3f-1196c6add518 service nova] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_rules [ 736.751573] env[69360]: INFO networking_nsxv3.common.synchronization [req-877216f0-a699-42aa-99bb-4a741dc9bd1b req-5ea282eb-a318-4de1-be3f-1196c6add518 service nova] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 736.751635] env[69360]: INFO networking_nsxv3.common.synchronization [req-877216f0-a699-42aa-99bb-4a741dc9bd1b req-5ea282eb-a318-4de1-be3f-1196c6add518 service nova] Enqueued Resource ID: b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c with Priority: HIGHEST for action port [ 736.752087] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_rules [ 736.752087] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 736.752208] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c with Priority: HIGHEST for action port [ 736.753731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.753731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.753731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.759763] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.759763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.759763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.759763] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.759763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.759763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.760724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.760724] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.265360] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c with status ACTIVE [ 737.266039] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.266039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.266039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.266039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.266260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.266362] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.266427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.266517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.266651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.266770] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.266900] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.266996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.267075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.267237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.267304] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.267394] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c is going to be updated. [ 737.268583] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.269639] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.269639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.289589] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.289746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.289806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.290212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.290397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.290615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4b0bb3d-a7c4-42e8-99f2-9078bf5e2b6c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.628939] env[69360]: INFO networking_nsxv3.common.synchronization [req-fa32840b-b5e6-49ce-89e8-6324af525819 req-97a6b145-ac98-4d6f-933e-ea36d34a5ad9 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 737.629113] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 737.629981] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.630134] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.630199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.630467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.630639] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.630787] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.630868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.631060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.631155] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.631251] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.771475] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.976488] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 737.976628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.134271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.135902] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.135902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.136256] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 already deleted. [ 738.136256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.185411] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.185608] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.186361] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.186361] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.186361] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.187211] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.188125] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.188328] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.188522] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.189079] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.191131] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.191236] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.191359] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.191489] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 738.191590] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.191765] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.215546] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.215718] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 738.216481] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.216481] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.216481] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-00ad3cfd-f282-442d-b152-85e841dd8a16 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.216816] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.216816] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.217034] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.217223] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00ad3cfd-f282-442d-b152-85e841dd8a16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.277274] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.277402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.277480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.277709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.277802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.277904] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf is going to be created. [ 738.306801] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.307061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.307156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.307378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.307544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.318566] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: UNINITIALIZED for 2s [ 738.719602] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.719898] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.720071] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.720396] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.720592] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.720776] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 00ad3cfd-f282-442d-b152-85e841dd8a16 not found, creating... [ 738.721055] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.721241] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.721363] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.721635] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.721781] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.722133] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.722444] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.722503] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.722767] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.722947] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.723157] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 00ad3cfd-f282-442d-b152-85e841dd8a16 is going to be created. [ 738.753732] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.754058] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.754273] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.754647] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.754941] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.755246] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.642542] env[69360]: INFO networking_nsxv3.common.synchronization [req-fa32840b-b5e6-49ce-89e8-6324af525819 req-dbd3b4dd-d575-4979-8752-3ae5760b8349 service nova] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 739.642852] env[69360]: INFO networking_nsxv3.common.synchronization [req-fa32840b-b5e6-49ce-89e8-6324af525819 req-dbd3b4dd-d575-4979-8752-3ae5760b8349 service nova] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 739.642889] env[69360]: INFO networking_nsxv3.common.synchronization [req-fa32840b-b5e6-49ce-89e8-6324af525819 req-dbd3b4dd-d575-4979-8752-3ae5760b8349 service nova] Enqueued Resource ID: 00ad3cfd-f282-442d-b152-85e841dd8a16 with Priority: HIGHEST for action port [ 739.643486] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_rules [ 739.643661] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 739.643799] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ad3cfd-f282-442d-b152-85e841dd8a16 with Priority: HIGHEST for action port [ 739.645228] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.645228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.645228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.645228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.645228] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.645579] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.647460] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.647460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.647460] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.648192] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-00ad3cfd-f282-442d-b152-85e841dd8a16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.648303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.648367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.648572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.648671] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00ad3cfd-f282-442d-b152-85e841dd8a16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.154019] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.154019] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.154019] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00ad3cfd-f282-442d-b152-85e841dd8a16 with status ACTIVE [ 740.154019] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.154019] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.154019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.154696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.154696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.155702] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.155702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.155702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.155702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.155702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.155702] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00ad3cfd-f282-442d-b152-85e841dd8a16 is going to be updated. [ 740.180089] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.180265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.180369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.180573] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.180726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.180895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00ad3cfd-f282-442d-b152-85e841dd8a16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.333039] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: SUCCESS [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.333039] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.333039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.333039] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.661405] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.837309] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.837495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.837594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.837828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.838007] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.838136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.838212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.838413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.838464] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.838539] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.838689] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.838783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.838851] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.839026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.839184] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.839277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.839328] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.839467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.839545] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.840810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.840810] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.166023] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.166023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.166023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.166023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.166023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.166023] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 is going to be created. [ 741.194024] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.194024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.194024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.194024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.194024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.211630] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: UNINITIALIZED for 2s [ 741.342570] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93cab96c-004c-44eb-9939-8484814e8bbf: rpc.has_security_group_logging(os_id): False [ 741.362809] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.363068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.363068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.363247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.363371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.363632] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.363788] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.363877] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.364042] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.364152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364347] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.364493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.364493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.364681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.364770] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.364991] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.365135] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.365213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.365343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.365423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.365527] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf is going to be created. [ 741.433491] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.433686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.433772] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.434433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.434433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.447645] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: IN_PROGRESS for 2s [ 743.226580] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: SUCCESS [ 743.226960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.230164] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.230475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.231359] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.231359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.231359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.231359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.231359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.231359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.231359] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.461561] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: SUCCESS [ 743.461836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.734143] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.239509] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5a08b4-b8f3-450e-a7ff-21a94b955679: rpc.has_security_group_logging(os_id): False [ 744.260345] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.260345] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.260460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.260619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.260716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.260991] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.261108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.261184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.261386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.261497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.261610] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 is going to be created. [ 744.326389] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.326569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.326609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.326811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.327806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.339649] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: IN_PROGRESS for 2s [ 744.644436] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 744.644634] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 746.355304] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: SUCCESS [ 746.355304] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.794044] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7682429f-498a-43a2-862b-c7238874d732 None None] Enqueued Resource ID: cdc5dcda-2b6a-4437-8601-7fa1c9043118 with Priority: HIGHEST for action port [ 746.794382] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdc5dcda-2b6a-4437-8601-7fa1c9043118 with Priority: HIGHEST for action port [ 746.796110] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdc5dcda-2b6a-4437-8601-7fa1c9043118 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.796110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdc5dcda-2b6a-4437-8601-7fa1c9043118" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.796110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdc5dcda-2b6a-4437-8601-7fa1c9043118" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.796110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdc5dcda-2b6a-4437-8601-7fa1c9043118" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.796110] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdc5dcda-2b6a-4437-8601-7fa1c9043118',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.299550] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdc5dcda-2b6a-4437-8601-7fa1c9043118 [ 747.299771] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.299921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.300022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.300266] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.300359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.300461] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdc5dcda-2b6a-4437-8601-7fa1c9043118 already deleted. [ 747.300917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdc5dcda-2b6a-4437-8601-7fa1c9043118" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.976946] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8d1d3bf1-fbde-42c1-8521-79f03d56a5e1 None None] Enqueued Resource ID: 2af02f63-c929-4de5-9812-de7c2153965f with Priority: HIGHEST for action port [ 748.976946] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2af02f63-c929-4de5-9812-de7c2153965f with Priority: HIGHEST for action port [ 748.976946] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2af02f63-c929-4de5-9812-de7c2153965f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.976946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2af02f63-c929-4de5-9812-de7c2153965f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.976946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2af02f63-c929-4de5-9812-de7c2153965f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.977741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2af02f63-c929-4de5-9812-de7c2153965f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.977923] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2af02f63-c929-4de5-9812-de7c2153965f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.480820] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2af02f63-c929-4de5-9812-de7c2153965f [ 749.481093] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.481253] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.481326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.481534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.481629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.481731] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2af02f63-c929-4de5-9812-de7c2153965f already deleted. [ 749.481812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2af02f63-c929-4de5-9812-de7c2153965f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.547742] env[69360]: INFO networking_nsxv3.common.synchronization [None req-605bcb97-9bb2-47aa-a1b6-eb03d306068e None None] Enqueued Resource ID: dc8b5094-dd6e-425e-848d-8cdc47922057 with Priority: HIGHEST for action port [ 752.548609] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc8b5094-dd6e-425e-848d-8cdc47922057 with Priority: HIGHEST for action port [ 752.549230] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc8b5094-dd6e-425e-848d-8cdc47922057 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.549371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc8b5094-dd6e-425e-848d-8cdc47922057" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.549428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc8b5094-dd6e-425e-848d-8cdc47922057" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.549666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc8b5094-dd6e-425e-848d-8cdc47922057" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.549742] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc8b5094-dd6e-425e-848d-8cdc47922057',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.051827] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc8b5094-dd6e-425e-848d-8cdc47922057 [ 753.051982] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.052107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.052218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.052605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.052605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.052605] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc8b5094-dd6e-425e-848d-8cdc47922057 already deleted. [ 753.052751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc8b5094-dd6e-425e-848d-8cdc47922057" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.986619] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8c062187-23de-45c0-a59c-66296ca5db8f None None] Enqueued Resource ID: 8fa079b5-d159-48ce-b010-45bbc7ea1e45 with Priority: HIGHEST for action port [ 754.986897] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fa079b5-d159-48ce-b010-45bbc7ea1e45 with Priority: HIGHEST for action port [ 754.987568] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fa079b5-d159-48ce-b010-45bbc7ea1e45 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.987639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fa079b5-d159-48ce-b010-45bbc7ea1e45" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.987727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fa079b5-d159-48ce-b010-45bbc7ea1e45" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.987926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fa079b5-d159-48ce-b010-45bbc7ea1e45" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.988152] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fa079b5-d159-48ce-b010-45bbc7ea1e45',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.490141] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fa079b5-d159-48ce-b010-45bbc7ea1e45 [ 755.490412] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.490578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.490657] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.490902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.491086] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.491222] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fa079b5-d159-48ce-b010-45bbc7ea1e45 already deleted. [ 755.491322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fa079b5-d159-48ce-b010-45bbc7ea1e45" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.987967] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 759.988353] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 764.989765] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 764.990153] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 766.102951] env[69360]: INFO networking_nsxv3.common.synchronization [None req-06c779f8-5eac-4cdb-9c17-9aadaa6c5606 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 with Priority: HIGHEST for action security_group_rules [ 766.103814] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 with Priority: HIGHEST for action security_group_rules [ 766.104914] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6f7c887-569b-4c2a-a142-f11ba4c40713 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.105059] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.105059] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.105552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.105552] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6f7c887-569b-4c2a-a142-f11ba4c40713',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.240345] env[69360]: INFO networking_nsxv3.common.synchronization [None req-51f5dcec-52a0-4b49-a5d7-9fc56f1f5c22 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 with Priority: HIGHEST for action security_group_rules [ 766.240867] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 with Priority: HIGHEST for action security_group_rules [ 766.241184] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6f7c887-569b-4c2a-a142-f11ba4c40713 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.241288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.628681] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.630686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.630875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.631188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.631754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.631948] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 already deleted. [ 766.632184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.637052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.637052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.637052] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6f7c887-569b-4c2a-a142-f11ba4c40713',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.158912] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.160170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.160170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.160170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.160170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.160170] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6f7c887-569b-4c2a-a142-f11ba4c40713 already deleted. [ 767.160170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6f7c887-569b-4c2a-a142-f11ba4c40713" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.604508] env[69360]: INFO networking_nsxv3.common.synchronization [req-6853d6a0-2173-46e7-8542-239f48c4a2c9 req-585d46f0-2484-45c1-bc77-8ec5eaed787a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 769.604793] env[69360]: INFO networking_nsxv3.common.synchronization [req-6853d6a0-2173-46e7-8542-239f48c4a2c9 req-585d46f0-2484-45c1-bc77-8ec5eaed787a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 769.604793] env[69360]: INFO networking_nsxv3.common.synchronization [req-6853d6a0-2173-46e7-8542-239f48c4a2c9 req-585d46f0-2484-45c1-bc77-8ec5eaed787a tempest-SecurityGroupsTestJSON-322828888 tempest-SecurityGroupsTestJSON-322828888-project-member] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 769.605467] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGHEST for action security_group_members [ 769.606056] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGHEST for action security_group_members [ 769.606056] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGHEST for action security_group_members [ 769.606056] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.606216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.606216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.606370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.606537] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.606628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.606628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.608437] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.608437] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.608437] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.608437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.608909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.608909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.608909] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.609358] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.609492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.609532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.609670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.609803] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.609895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.609961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.610138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.610218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.610323] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.112271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.112925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.112925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.112925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.113141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.113882] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.113882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.113882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.113882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.114145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.114145] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be updated. [ 770.116636] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.116763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.116832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.116995] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.118264] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.118264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.138574] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.138845] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.138965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.139052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.139264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.139412] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.139511] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be updated. [ 770.142017] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.142235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.148020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.148020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.148020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.148020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.148020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.156177] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: IN_PROGRESS for 2s [ 770.178178] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.178178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.178178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.178178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.178178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.178396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.178466] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.178555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.178627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.182020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.182020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.182020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be updated. [ 770.188878] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: IN_PROGRESS for 2s [ 770.213543] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.213543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.213543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.213543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.213543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.221268] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: IN_PROGRESS for 2s [ 772.165864] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3694c3f2-85a3-493d-8c83-767e017321ab in Status: SUCCESS [ 772.166221] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab deletion is rescheduled due to dependency. [ 772.166221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.205161] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa in Status: SUCCESS [ 772.205343] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa deletion is rescheduled due to dependency. [ 772.205465] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.230919] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e in Status: SUCCESS [ 772.231140] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e deletion is rescheduled due to dependency. [ 772.231272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.681132] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-81b27d6a-c623-4e01-a10e-57640824e2e9 tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 772.681132] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 772.681443] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.681443] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.681532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.681680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.681828] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.681924] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.681993] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.682600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.682710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.682806] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.090288] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.090552] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.090681] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.090952] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.091256] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.091424] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.091562] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.091900] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.092218] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.092490] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.092616] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.092738] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.092870] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.092994] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.093117] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.093252] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.113067] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.113263] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.113357] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.113527] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.113872] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-12a5e1ba-1f50-4421-a715-d2e4cbb74000 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.114073] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.114225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.114719] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.114874] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a5e1ba-1f50-4421-a715-d2e4cbb74000',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.185194] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.185489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.185489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.185730] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.205473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.205765] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.205915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.205992] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.206233] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.206346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.206523] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 773.234030] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.234183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.234183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.234380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.234523] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.244119] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 773.616741] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.616982] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.620410] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 12a5e1ba-1f50-4421-a715-d2e4cbb74000 not found, creating... [ 773.620410] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.620410] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.620410] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.622457] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.622799] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.622883] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.623045] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.623206] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 12a5e1ba-1f50-4421-a715-d2e4cbb74000 is going to be created. [ 773.645015] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645222] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645347] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.646023] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.646023] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.646414] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.574598] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-c366eeae-b789-4139-b754-f5263b16aa2d service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 774.574997] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-c366eeae-b789-4139-b754-f5263b16aa2d service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 774.574997] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-c366eeae-b789-4139-b754-f5263b16aa2d service nova] Enqueued Resource ID: 12a5e1ba-1f50-4421-a715-d2e4cbb74000 with Priority: HIGHEST for action port [ 774.575286] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 774.575417] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 774.575513] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a5e1ba-1f50-4421-a715-d2e4cbb74000 with Priority: HIGHEST for action port [ 774.577658] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.577870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.577975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.578296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.578433] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.579379] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.579475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.580986] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a5e1ba-1f50-4421-a715-d2e4cbb74000 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.581116] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.581729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.581729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.582361] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a5e1ba-1f50-4421-a715-d2e4cbb74000',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.087522] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.087665] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.087833] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12a5e1ba-1f50-4421-a715-d2e4cbb74000 with status ACTIVE [ 775.088016] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.088135] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.088202] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.088418] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.088536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.088733] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.088831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.088893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.089214] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.089214] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.089307] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.089477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.089477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.089651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.089651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.089721] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12a5e1ba-1f50-4421-a715-d2e4cbb74000 is going to be updated. [ 775.115086] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.115289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.115364] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.115578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.115718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.115880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a5e1ba-1f50-4421-a715-d2e4cbb74000" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.255410] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 775.255623] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 deletion is rescheduled due to dependency. [ 775.255719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.255860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.256101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.256290] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.256408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.256478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.256611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.256728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.256790] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.459054] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0b9caedb-c02d-4f16-b321-a66760679ac2 None None] Enqueued Resource ID: c5257e94-df90-418a-b055-1a3d1fe9043d with Priority: HIGHEST for action port [ 775.459647] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5257e94-df90-418a-b055-1a3d1fe9043d with Priority: HIGHEST for action port [ 775.459947] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5257e94-df90-418a-b055-1a3d1fe9043d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.460084] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5257e94-df90-418a-b055-1a3d1fe9043d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.460146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5257e94-df90-418a-b055-1a3d1fe9043d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.460393] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5257e94-df90-418a-b055-1a3d1fe9043d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.460477] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5257e94-df90-418a-b055-1a3d1fe9043d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.759036] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.964596] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c5257e94-df90-418a-b055-1a3d1fe9043d [ 775.964841] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.964980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.965063] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.965273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.965365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.965461] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c5257e94-df90-418a-b055-1a3d1fe9043d already deleted. [ 775.965541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5257e94-df90-418a-b055-1a3d1fe9043d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.262590] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.573954] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-934479d8-4450-41bb-9a57-72e80e3eb13e tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 776.575530] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 776.575860] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.575962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.765553] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.765826] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.765826] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.768021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.768021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.768021] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 776.799025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.799025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.799025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.799531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.799531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.809097] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 776.904416] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-446 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.904646] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.904807] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.904976] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.905443] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.905443] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.905552] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.905683] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.905989] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.906058] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.906704] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.906704] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.906704] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.906704] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 776.906704] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.907212] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.930123] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.930123] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 776.930579] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.930787] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-446" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.931575] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.932172] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.932394] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.932874] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.933592] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.436219] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.436461] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.436595] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.436871] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.437036] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.437195] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 not found, creating... [ 777.437457] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.437615] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.437733] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.437966] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.438111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.438394] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.439478] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.439684] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.440019] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.440165] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.440325] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 is going to be created. [ 777.462471] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.462471] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.462471] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.462779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.462779] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.463396] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.685484] env[69360]: INFO networking_nsxv3.common.synchronization [None req-45ab7c8f-c4f9-4176-ab5c-af0815142e7c None None] Enqueued Resource ID: e857e255-7880-4409-ba83-c6c086a3bd25 with Priority: HIGHEST for action port [ 777.686055] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e857e255-7880-4409-ba83-c6c086a3bd25 with Priority: HIGHEST for action port [ 777.687250] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e857e255-7880-4409-ba83-c6c086a3bd25 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.687250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e857e255-7880-4409-ba83-c6c086a3bd25" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.687250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e857e255-7880-4409-ba83-c6c086a3bd25" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.688371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e857e255-7880-4409-ba83-c6c086a3bd25" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.688371] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e857e255-7880-4409-ba83-c6c086a3bd25',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.190451] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e857e255-7880-4409-ba83-c6c086a3bd25 [ 778.190785] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.190785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.190901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.191070] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.191165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.191283] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e857e255-7880-4409-ba83-c6c086a3bd25 already deleted. [ 778.191335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e857e255-7880-4409-ba83-c6c086a3bd25" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.212805] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-82e97ade-51f5-4a65-859f-01dd1ea86708 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 778.214363] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-82e97ade-51f5-4a65-859f-01dd1ea86708 service nova] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 778.215228] env[69360]: INFO networking_nsxv3.common.synchronization [req-fd8398d1-16ed-4275-86a1-0099d2a35c5e req-82e97ade-51f5-4a65-859f-01dd1ea86708 service nova] Enqueued Resource ID: 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 with Priority: HIGHEST for action port [ 778.215906] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_rules [ 778.216144] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 778.216220] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 with Priority: HIGHEST for action port [ 778.216510] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.216643] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.216921] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.217027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.217243] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.217394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.217428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.217632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.217715] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.722646] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 with status ACTIVE [ 778.722646] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.722646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.722646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.722881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.722881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.723038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.723038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.723123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.723237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.723308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.723491] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.723580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.723632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.723765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.723834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.723914] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5 is going to be updated. [ 778.746758] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.746920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.746972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.747369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.747369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.747489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da2a1bd-4886-4d63-82a9-cd4fdd2c31d5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.818874] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 778.819100] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.819284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.819501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.819692] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.819809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.819878] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.820046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.820130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.820218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.820315] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.821450] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.821568] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.821683] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.821784] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.821846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.822048] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.822150] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.822213] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.326080] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.327036] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.327472] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.549765] env[69360]: INFO networking_nsxv3.common.synchronization [req-7db65717-e9d4-4216-a205-1bcede4b437d req-6de7222b-01d1-4129-8126-c81ea7a9562c tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 779.550334] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 779.550931] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.550931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.550931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.551148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.552062] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.552062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.552062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.552062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.552062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.552062] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.831150] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.940097] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.940310] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.940436] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.940785] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.941060] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.941225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.941345] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.941567] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.941721] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.941924] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.942255] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 779.942398] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 779.942513] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 779.942630] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 779.942735] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 779.942869] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 779.964148] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 779.964382] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 779.964535] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 779.964714] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.965042] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.965219] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.965340] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.965662] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.965805] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.054510] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.054713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.054713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.054933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.055047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.055279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.055383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.055454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.055608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.055686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.055773] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 already deleted. [ 780.055855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.334159] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.334159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.334159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.334159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.334159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.334535] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 780.362845] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.362982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.363093] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.363307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.363451] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.373212] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 780.470111] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.470111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.470111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.470111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.470111] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.470450] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 not found, creating... [ 780.470741] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.470926] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.471109] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.471381] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.471597] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.472326] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.472326] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.472529] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.472812] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.472910] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.473125] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 is going to be created. [ 780.493793] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.493878] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.494091] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.494261] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.495235] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.495235] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.324992] env[69360]: INFO networking_nsxv3.common.synchronization [req-7db65717-e9d4-4216-a205-1bcede4b437d req-8e6f3423-2ad7-4dd6-9352-5cdbeaefe5f5 service nova] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 781.325236] env[69360]: INFO networking_nsxv3.common.synchronization [req-7db65717-e9d4-4216-a205-1bcede4b437d req-8e6f3423-2ad7-4dd6-9352-5cdbeaefe5f5 service nova] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 781.325399] env[69360]: INFO networking_nsxv3.common.synchronization [req-7db65717-e9d4-4216-a205-1bcede4b437d req-8e6f3423-2ad7-4dd6-9352-5cdbeaefe5f5 service nova] Enqueued Resource ID: cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 with Priority: HIGHEST for action port [ 781.325963] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_rules [ 781.326132] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 781.326290] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 with Priority: HIGHEST for action port [ 781.326634] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.326634] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.326789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.326909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.326985] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.327928] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.328065] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.328136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.328332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.328503] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.328670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.328670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.328841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.328921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.329033] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.334031] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.334031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.334031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.334031] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.334031] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.834525] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 with status ACTIVE [ 781.834835] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.835039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.835135] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.835389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.835515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.835770] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.836082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.836082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.836198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.836293] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.836525] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.836647] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.836734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.836904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.837039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.837114] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1 is going to be updated. [ 781.838487] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.838631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.838808] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.865027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.865235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.865283] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.865453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.865795] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.865795] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb95db9d-9279-4fd5-bf3d-c4edcbfd26c1" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.341761] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.384422] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 782.384620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.384762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.384982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.385389] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.385529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.385597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.385753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.385836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.385933] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.844055] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.844055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.844055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.844357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.844357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.844433] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 is going to be created. [ 782.868550] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.868697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.868767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.868986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.869196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.880228] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: UNINITIALIZED for 2s [ 782.888611] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.390449] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.894222] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.894407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.894467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.896476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.896476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.896476] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 783.923240] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.923240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.923240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.923240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.923240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.933158] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 784.891201] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: SUCCESS [ 784.891468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.891660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.891958] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.892197] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.892359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.892450] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.892638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.892728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.892816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.892906] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.395624] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.898580] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd08a380-9c77-45fd-8594-1c3028cb2547: rpc.has_security_group_logging(os_id): False [ 785.924311] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.924476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.924547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.924777] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.924870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.925164] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.925250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.925311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.925447] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.925517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.926014] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 is going to be created. [ 785.950922] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 785.951181] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.951374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.951659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.951862] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.952172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.952316] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.952441] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.952522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.952651] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.952823] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953604] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.953604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.953604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.953604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.953838] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.028582] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.028766] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.028815] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.029041] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.029238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.046620] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: IN_PROGRESS for 2s [ 786.327774] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 786.328998] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 786.456145] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5e5a270-0e63-466e-949b-b541894e9b16: rpc.has_security_group_logging(os_id): False [ 786.477403] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.477625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.477748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.477954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.478067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.478319] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.478454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.478547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.478709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.478866] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.478966] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.479073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.479137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.479278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.479352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.479555] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.479688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.479760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.479908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.479983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.480083] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 786.539137] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.540039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.540039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.540039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.540039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.558462] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 788.065927] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: SUCCESS [ 788.066398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.575127] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 788.575430] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.575655] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.575997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.576107] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.080323] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.080981] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.080981] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.080981] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.080981] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.080981] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.081321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.081321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.081321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.081437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.081474] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.586621] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.586967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.587129] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.587454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.587621] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.587749] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.587837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.588034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.588161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.588278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.588473] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.588601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.588685] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.588855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.589020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.589538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.589538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.589538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.589538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.589752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.590726] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.851225] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 789.851225] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:1 started [ 790.094384] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5e5a270-0e63-466e-949b-b541894e9b16: rpc.has_security_group_logging(os_id): False [ 790.113992] env[69360]: INFO networking_nsxv3.common.synchronization [req-29fe1fd3-03fb-4277-958e-0ff9f92cf48e req-26957d08-d115-47db-9d5f-b3eb871985c3 tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 790.116442] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.116726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.116726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.116907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.117093] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.117244] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.117344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.117409] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.117611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.117702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.117887] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.117982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.118056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.118197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.118270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.118451] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.118544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.118587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.118772] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.118834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.118865] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 790.120948] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 790.122629] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.122744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.122814] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.123555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.123555] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.123555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.123555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.123555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.123555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.123555] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.186052] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.186239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.186316] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.186553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.186706] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.202830] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 790.432995] env[69360]: INFO networking_nsxv3.common.synchronization [req-732e6b23-494d-4673-a2d3-4e5758dc78a7 req-b6fcfbf0-9601-45ef-96a8-f4580cc1ee18 tempest-MultipleCreateTestJSON-1024910139 tempest-MultipleCreateTestJSON-1024910139-project-member] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 790.433562] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGHEST for action security_group_members [ 790.433873] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.433978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.627984] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.133236] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.636697] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.636878] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.636924] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.637801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.637801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.637801] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 791.670054] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.670251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.670347] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.670541] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.670689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.679113] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 792.217737] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 792.218028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.694510] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 793.694861] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.694941] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.695160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.695348] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.695571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.695571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.695722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.695797] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.695858] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.198541] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.198741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.198783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.198991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.199101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.199297] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.199397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.199462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.199609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.199686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.199776] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be updated. [ 794.228404] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.228564] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.228629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.228876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.229032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.238640] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: IN_PROGRESS for 2s [ 795.434156] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 795.434552] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 796.250998] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5e5a270-0e63-466e-949b-b541894e9b16 in Status: SUCCESS [ 796.251316] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 deletion is rescheduled due to dependency. [ 796.251442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.752320] env[69360]: INFO networking_nsxv3.common.synchronization [None req-134da689-d94e-4e06-b5bc-78c9ae8135cf None None] Enqueued Resource ID: 1d3de8d9-1596-489d-99a4-6cf9da9c84c8 with Priority: HIGHEST for action port [ 798.752635] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d3de8d9-1596-489d-99a4-6cf9da9c84c8 with Priority: HIGHEST for action port [ 798.753188] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d3de8d9-1596-489d-99a4-6cf9da9c84c8 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.753315] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d3de8d9-1596-489d-99a4-6cf9da9c84c8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.753490] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d3de8d9-1596-489d-99a4-6cf9da9c84c8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.753626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d3de8d9-1596-489d-99a4-6cf9da9c84c8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.753706] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d3de8d9-1596-489d-99a4-6cf9da9c84c8',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.257035] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1d3de8d9-1596-489d-99a4-6cf9da9c84c8 [ 799.257035] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.257035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.257035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.257035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.257035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.257035] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1d3de8d9-1596-489d-99a4-6cf9da9c84c8 already deleted. [ 799.257035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d3de8d9-1596-489d-99a4-6cf9da9c84c8" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.661171] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b4b5def2-2158-46dd-bd18-5c4c6d6ffe29 None None] Enqueued Resource ID: 0e9a294b-a140-48c7-a014-bc134ddc244d with Priority: HIGHEST for action port [ 799.661171] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e9a294b-a140-48c7-a014-bc134ddc244d with Priority: HIGHEST for action port [ 799.661171] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e9a294b-a140-48c7-a014-bc134ddc244d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.661330] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e9a294b-a140-48c7-a014-bc134ddc244d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.661369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e9a294b-a140-48c7-a014-bc134ddc244d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.661611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e9a294b-a140-48c7-a014-bc134ddc244d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.661694] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9a294b-a140-48c7-a014-bc134ddc244d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.168666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e9a294b-a140-48c7-a014-bc134ddc244d [ 800.168891] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.169044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.169120] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.169336] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.169429] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.169526] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e9a294b-a140-48c7-a014-bc134ddc244d already deleted. [ 800.169606] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e9a294b-a140-48c7-a014-bc134ddc244d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.932952] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0388cbaf-8979-442d-b3da-859a8ee32776 None None] Enqueued Resource ID: 4ed01170-0527-4ecc-af0c-864e82260ee0 with Priority: HIGHEST for action port [ 800.933285] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ed01170-0527-4ecc-af0c-864e82260ee0 with Priority: HIGHEST for action port [ 800.933905] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ed01170-0527-4ecc-af0c-864e82260ee0 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.934058] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ed01170-0527-4ecc-af0c-864e82260ee0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.934130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ed01170-0527-4ecc-af0c-864e82260ee0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.934380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ed01170-0527-4ecc-af0c-864e82260ee0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.934459] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ed01170-0527-4ecc-af0c-864e82260ee0',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.437801] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ed01170-0527-4ecc-af0c-864e82260ee0 [ 801.437801] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.437801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.437801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.437801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.437801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.437801] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ed01170-0527-4ecc-af0c-864e82260ee0 already deleted. [ 801.437801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ed01170-0527-4ecc-af0c-864e82260ee0" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.126025] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f021fce3-49b5-4cb8-a116-ee5c2d78f6f0 None None] Enqueued Resource ID: c4179671-91e1-4429-a627-6909a6fbaf26 with Priority: HIGHEST for action port [ 802.126025] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4179671-91e1-4429-a627-6909a6fbaf26 with Priority: HIGHEST for action port [ 802.126025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4179671-91e1-4429-a627-6909a6fbaf26 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.126025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4179671-91e1-4429-a627-6909a6fbaf26" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.126025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4179671-91e1-4429-a627-6909a6fbaf26" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.126025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4179671-91e1-4429-a627-6909a6fbaf26" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.126025] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4179671-91e1-4429-a627-6909a6fbaf26',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.632828] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4179671-91e1-4429-a627-6909a6fbaf26 [ 802.632828] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.632828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.632828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.632828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.632828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.632828] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4179671-91e1-4429-a627-6909a6fbaf26 already deleted. [ 802.632828] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4179671-91e1-4429-a627-6909a6fbaf26" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.721753] env[69360]: INFO networking_nsxv3.common.synchronization [req-85ae9545-2286-457b-9c4a-a112188816da req-0ed2c144-e385-40ff-b1ba-5012c3d2e4bb tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 803.722441] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 803.722687] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.722778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.722840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.723374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.723534] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.723637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.725640] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.725640] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.725640] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.725640] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.027430] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.027594] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.027636] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.027893] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.028483] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.028483] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.028483] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.028713] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.028756] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.029053] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.030020] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.030020] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.030020] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.030020] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 804.030020] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.030020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.050017] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.050638] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 804.050638] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.050780] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.051091] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-adb5a8dc-4297-4171-b593-e1230f1746c7 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.051243] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.051710] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.051710] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.051818] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb5a8dc-4297-4171-b593-e1230f1746c7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.229132] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.229132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.229132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.229132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.229132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.229327] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.229327] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.229412] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.229839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.229839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.229839] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f already deleted. [ 804.230080] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.554721] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.554929] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.555164] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.555334] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.555493] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.555955] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port adb5a8dc-4297-4171-b593-e1230f1746c7 not found, creating... [ 804.555955] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.556188] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.556296] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.556472] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.556615] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.556926] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.557104] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.557228] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.558034] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.558034] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.558034] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: adb5a8dc-4297-4171-b593-e1230f1746c7 is going to be created. [ 804.578312] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.578489] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.578614] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.578888] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.579134] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.579449] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.646255] env[69360]: INFO networking_nsxv3.common.synchronization [req-85ae9545-2286-457b-9c4a-a112188816da req-33ed4d33-b99f-4b64-bc0f-845e30201cfc service nova] Enqueued Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_rules [ 805.646630] env[69360]: INFO networking_nsxv3.common.synchronization [req-85ae9545-2286-457b-9c4a-a112188816da req-33ed4d33-b99f-4b64-bc0f-845e30201cfc service nova] Enqueued Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 805.646630] env[69360]: INFO networking_nsxv3.common.synchronization [req-85ae9545-2286-457b-9c4a-a112188816da req-33ed4d33-b99f-4b64-bc0f-845e30201cfc service nova] Enqueued Resource ID: adb5a8dc-4297-4171-b593-e1230f1746c7 with Priority: HIGHEST for action port [ 805.646808] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_rules [ 805.646941] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 805.647060] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb5a8dc-4297-4171-b593-e1230f1746c7 with Priority: HIGHEST for action port [ 805.647680] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.647796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.647845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.648106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.648201] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.649057] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.649222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.649265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.649470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.649572] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.649674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.649738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.649952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.650055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.651435] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.651618] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb5a8dc-4297-4171-b593-e1230f1746c7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.651618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.651779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.652799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.652799] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb5a8dc-4297-4171-b593-e1230f1746c7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.797456] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.797615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.797687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.797900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.798014] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.154466] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.154466] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.154466] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.154799] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adb5a8dc-4297-4171-b593-e1230f1746c7 with status ACTIVE [ 806.154950] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.155097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.155195] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.155452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.155912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.155912] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.155912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.156184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.156251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.156346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.156573] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.156936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.157122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.157295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.157338] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.157415] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adb5a8dc-4297-4171-b593-e1230f1746c7 is going to be updated. [ 806.178733] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.178914] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.178996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.179268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.179467] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.179661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb5a8dc-4297-4171-b593-e1230f1746c7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.303779] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.659592] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.806355] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.085338] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7e3f1921-8418-4bbf-a2da-70fd81ca5d18 None None] Enqueued Resource ID: e38f749e-be35-44fa-81af-2463a7a8acf9 with Priority: HIGHEST for action port [ 807.085867] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38f749e-be35-44fa-81af-2463a7a8acf9 with Priority: HIGHEST for action port [ 807.086252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38f749e-be35-44fa-81af-2463a7a8acf9 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.086852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38f749e-be35-44fa-81af-2463a7a8acf9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.086852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38f749e-be35-44fa-81af-2463a7a8acf9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.086852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38f749e-be35-44fa-81af-2463a7a8acf9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.087144] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38f749e-be35-44fa-81af-2463a7a8acf9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.164986] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.164986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.164986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.164986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.164986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.164986] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f is going to be created. [ 807.199998] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.200206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.200353] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.200532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.200698] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.212712] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: UNINITIALIZED for 2s [ 807.310149] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 807.310149] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 807.595175] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e38f749e-be35-44fa-81af-2463a7a8acf9 [ 807.595356] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.595531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.595618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.595842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.595974] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.596104] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e38f749e-be35-44fa-81af-2463a7a8acf9 already deleted. [ 807.596260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38f749e-be35-44fa-81af-2463a7a8acf9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.150277] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.150691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.150691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.150829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.163217] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 808.164289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.165509] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 808.199259] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.201656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.201656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.201656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.204093] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.207689] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 808.207689] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 808.207689] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 808.264414] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.264414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.264414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.264414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.264954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.265131] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 808.326215] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.326411] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.326488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.326726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.326937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.327138] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 808.369463] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.369659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.369744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.371141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.371141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.371141] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:18. [ 808.371141] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d4f9a399-698a-42da-8c89-814b7c1e7204', 'c8e6f228-ab6c-4d13-b101-bef38530e43f', '2703b410-f705-4fcc-9444-dcfc58a56134', '158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e', '9f5a08b4-b8f3-450e-a7ff-21a94b955679', 'dfd13ad9-86ad-486c-98eb-041e0786ee19', 'a55b27fd-fe87-4592-84d0-620efe1b57cf', 'fea7482e-7e57-4680-8c8a-3228e37bba95', 'f9363c60-0dc4-4a51-8ca5-3290a7dda024', '93cab96c-004c-44eb-9939-8484814e8bbf', '134f4dd0-da38-412e-8a3e-b3a08f7896fa', '9d8489e0-bcca-4116-a053-e2f77ca08a2b', 'cd08a380-9c77-45fd-8594-1c3028cb2547', 'cbde8810-49af-4182-a254-894a61c0037e', 'd0fbef34-d753-4a4a-92ea-55434312119d', '3694c3f2-85a3-493d-8c83-767e017321ab', 'e5e5a270-0e63-466e-949b-b541894e9b16', '57cf0f6c-869d-4d08-b17d-3fb1a59953c5'} {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 808.371141] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 808.392682] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.392849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.392904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.393123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.393227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.393427] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 808.393501] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 808.393572] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 808.438843] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.439281] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.439392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.439581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.440056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.440235] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 808.440313] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 808.440637] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 808.440723] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 808.440783] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 18/18 resources of Type:Security Group Rules [ 808.440857] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGH for action security_group_rules [ 808.440938] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGH for action security_group_rules [ 808.441018] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGH for action security_group_rules [ 808.441081] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGH for action security_group_rules [ 808.441143] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGH for action security_group_rules [ 808.441614] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGH for action security_group_rules [ 808.441614] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGH for action security_group_rules [ 808.441614] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGH for action security_group_rules [ 808.442073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGH for action security_group_rules [ 808.442073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGH for action security_group_rules [ 808.442073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGH for action security_group_rules [ 808.442073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGH for action security_group_rules [ 808.442073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGH for action security_group_rules [ 808.442235] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGH for action security_group_rules [ 808.442235] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGH for action security_group_rules [ 808.442302] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGH for action security_group_rules [ 808.442480] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGH for action security_group_rules [ 808.442480] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGH for action security_group_rules [ 808.442587] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 808.442587] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 808.442804] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.442925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.442991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.443462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.443588] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.443808] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.443906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.444074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.444170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.444251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.444629] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.444739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.444804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.444954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.445044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.445229] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.445317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.445373] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.445532] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.445620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.445902] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.445902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.446024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.446082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.446158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.446331] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.446424] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.446488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.446627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.446701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.446864] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.446953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.447019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.447155] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.447251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.447389] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.447479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.447540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.447674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.447748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.447911] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.448020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.448885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.449547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.449547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.449547] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.449547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.449547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.449919] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.449919] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.450087] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.450198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.450262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.450409] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.450485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.450683] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.450779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.450841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.450983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.451070] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.451242] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.451335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.451391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.451525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.451964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.452198] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.452295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.452359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.452520] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.452595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.452763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.452858] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.452920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.453276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.453360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.453533] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.453626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.453687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.453827] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.453902] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.454083] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.454297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.454297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.454399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.454477] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.454645] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.454735] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.454796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.454932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.455015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.455182] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.455275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.455336] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.455485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.455547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.455711] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.455800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.455860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.455995] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.456082] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.456247] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.456335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.456390] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.456518] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.456591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.456752] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.456841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.456901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.457219] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.457615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.457615] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.457615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.457615] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.457801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.457899] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.458072] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.458662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.458662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.458662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.458662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.458662] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 808.458662] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 808.459280] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 808.502099] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.502099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.502099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.502099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.502099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.502099] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 808.545728] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.545728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.545964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.545964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.546133] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.560437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.225353] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: SUCCESS [ 809.225676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.225912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.226227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.226496] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.226638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.226714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.226861] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.226940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.227036] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.227127] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.428174] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8bd22079-bcb5-405c-8bdf-40091ed2ab6c None None] Enqueued Resource ID: eac26eef-b612-4763-9fea-aedc4ac18706 with Priority: HIGHEST for action port [ 809.428770] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eac26eef-b612-4763-9fea-aedc4ac18706 with Priority: HIGHEST for action port [ 809.428945] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGH for action security_group_rules [ 809.429123] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGH for action security_group_rules [ 809.429224] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGH for action security_group_rules [ 809.429352] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGH for action security_group_rules [ 809.429462] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGH for action security_group_rules [ 809.429559] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGH for action security_group_rules [ 809.429678] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGH for action security_group_rules [ 809.429783] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGH for action security_group_rules [ 809.429898] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGH for action security_group_rules [ 809.429992] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGH for action security_group_rules [ 809.430902] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGH for action security_group_rules [ 809.433133] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGH for action security_group_rules [ 809.433288] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGH for action security_group_rules [ 809.433448] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGH for action security_group_rules [ 809.433563] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGH for action security_group_rules [ 809.433684] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGH for action security_group_rules [ 809.433791] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGH for action security_group_rules [ 809.433907] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGH for action security_group_rules [ 809.434245] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-eac26eef-b612-4763-9fea-aedc4ac18706 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.434405] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eac26eef-b612-4763-9fea-aedc4ac18706" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.434517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eac26eef-b612-4763-9fea-aedc4ac18706" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.434824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eac26eef-b612-4763-9fea-aedc4ac18706" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.434824] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eac26eef-b612-4763-9fea-aedc4ac18706',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.436264] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.436264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.436264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.436264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.436264] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.437176] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.437292] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.437427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.437550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.437638] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.438467] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.438680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.438680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.438842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.438927] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.440321] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.440470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.440543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.440855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.440935] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.441914] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.442074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.442225] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.442279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.442372] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.443317] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.443427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.443722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.443722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.443852] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.444748] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.444843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.444915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.445141] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.445302] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.446290] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.446445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.446506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.446653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.446726] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.447622] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.447748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.447821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.447997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.448085] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.448630] env[69360]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 809.449106] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.449241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.449336] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.449508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.449597] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.451123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.451242] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.451312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.451488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.451576] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.452463] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.453075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.453075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.453075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.453075] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.453775] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.453880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.453957] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.454146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.454241] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.455260] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.455380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.455446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.455626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.455720] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.456657] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.456727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.456790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.456962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.457049] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.457922] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.458043] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.458131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.458287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.458376] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.459414] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.459521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.459612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.459794] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.459866] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.461077] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.461203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.461275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.461451] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.461549] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.466828] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eac26eef-b612-4763-9fea-aedc4ac18706 [ 809.467027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.467227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.467227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.467482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.467548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.467671] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eac26eef-b612-4763-9fea-aedc4ac18706 already deleted. [ 809.467725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eac26eef-b612-4763-9fea-aedc4ac18706" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.494106] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.494290] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.494426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.494594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.520781] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.520942] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 is going to be deleted. [ 809.576806] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.576806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.576806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.576806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.576806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.576806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.732629] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.732751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.732751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.732969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.734271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.734271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.734271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.734271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.734686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.734686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.734686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.734686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.734686] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.985207] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.985207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.985207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.985207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.001690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.001933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.001933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.002073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.002857] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.002857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.002857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.002857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.002857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.002857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.002857] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.005514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.005640] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 is going to be deleted. [ 810.008111] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.008256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.008332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.008462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.008617] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.008719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.008783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.008917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.008998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.009096] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.009185] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.013920] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.014049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.014116] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.014306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.014463] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.014562] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.014632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.014764] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.014842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.014923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.015032] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.016955] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.018885] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.018885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.018885] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.026310] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.028912] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.041935] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f5a08b4-b8f3-450e-a7ff-21a94b955679: rpc.has_security_group_logging(os_id): False [ 810.044991] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.045164] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.045237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.045447] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.050468] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.050468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.061953] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.062199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.063853] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.063853] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.065026] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.065172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.074411] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.074571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.075424] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.075603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.076385] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.076385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.078061] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.078061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.078711] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.078798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.079613] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.079613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.081085] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 810.081085] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.081208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.085790] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 810.086291] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.086485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.089246] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 810.089816] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.089951] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 is going to be deleted. [ 810.091053] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.091304] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.139754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.139906] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b is going to be deleted. [ 810.141089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.141190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.160532] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.160767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.164426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.164605] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 is going to be deleted. [ 810.165557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.165768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.190017] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.190160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.213095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.213318] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be deleted. [ 810.214312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.214572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.218792] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.218957] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.239600] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8bbf7ed1-077f-45c1-80ad-3d178d8b260f: rpc.has_security_group_logging(os_id): False [ 810.245169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.245314] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be deleted. [ 810.246355] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.246593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.283628] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.283762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.285399] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.285544] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0fbef34-d753-4a4a-92ea-55434312119d is going to be deleted. [ 810.289909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.289909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.315568] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.315662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.334275] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.335868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbde8810-49af-4182-a254-894a61c0037e is going to be deleted. [ 810.335868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.335868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.371974] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.373392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.373392] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.373392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.380617] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.380695] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be deleted. [ 810.381823] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.382111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.383951] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.384159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.452739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.452881] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 is going to be deleted. [ 810.453993] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.454188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.507522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.507702] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be deleted. [ 810.508678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.509651] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.529512] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.529681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.529753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.530024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.530233] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.530344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.530410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.530579] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.530671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.530759] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.530911] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.531010] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.531080] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.531222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.531357] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.531447] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.531506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.531669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.531749] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.531845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.531937] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.534150] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.540645] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd08a380-9c77-45fd-8594-1c3028cb2547: rpc.has_security_group_logging(os_id): False [ 810.550427] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.550566] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.566789] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.566971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.568095] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.568312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.575201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.575201] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f is going to be deleted. [ 810.577120] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.577407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.590968] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.591146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.617672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.617827] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf is going to be deleted. [ 810.619193] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.619424] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.621548] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.621629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.676160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.676431] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.676537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.676604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.676815] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.676900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.677024] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 is going to be updated. [ 810.680247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.680497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.680580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.680705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.681040] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.681040] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.681156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.681250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.681351] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.681569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.681569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.681686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.681799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.682204] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.682204] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.682312] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.682385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.682529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.682653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.682733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.682934] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.683089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.683128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.683269] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.683343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.683537] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.683676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.683741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.683883] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.683958] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.684062] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f is going to be created. [ 810.685549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.685716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.685794] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.685927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.686110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.686262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.686341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.686579] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.686901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.687067] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.687201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.687248] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.687397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.687539] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.687787] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.687787] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.687879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.687953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.688079] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.688146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.688258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.688445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.688526] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.688635] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.690099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.690099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.728161] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.728357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.868454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.868454] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.868454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.868454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.868454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.868454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.868454] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 is going to be updated. [ 810.869865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.869865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.870170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.870354] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.870498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.870656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.870733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.870837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.870982] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.871169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.871243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.871350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.890382] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.890531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.890734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.891047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.891258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.891465] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.968514] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.968514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.968514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.968514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.968514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.983277] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: IN_PROGRESS for 2s [ 811.021498] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.021498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.021498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.021498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.021498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.038112] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93cab96c-004c-44eb-9939-8484814e8bbf: rpc.has_security_group_logging(os_id): False [ 811.038112] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfd13ad9-86ad-486c-98eb-041e0786ee19: rpc.has_security_group_logging(os_id): False [ 811.070805] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.071952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.071952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.072913] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.073778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.075697] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: IN_PROGRESS for 2s [ 811.091793] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.092014] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.092440] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.092827] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.095088] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.095762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.127893] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: IN_PROGRESS for 2s [ 811.148665] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 811.149217] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.149570] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.149915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.149915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.150013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.150124] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.150178] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 is going to be updated. [ 811.152264] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.152495] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.208273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.208669] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.208882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.208965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.209432] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.209432] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.209714] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.209905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.211122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.211951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.211951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.212564] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.212912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.212912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.212990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.213788] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.214618] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf is going to be updated. [ 811.340662] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.341033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.341033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.341278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.341471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.356131] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: IN_PROGRESS for 2s [ 811.371800] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.371800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.371800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.372164] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.374230] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.388132] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: IN_PROGRESS for 2s [ 812.297814] env[69360]: INFO networking_nsxv3.common.synchronization [None req-515d12e8-e637-43cd-b64d-8f514121b75a None None] Enqueued Resource ID: f979a2e4-5a69-449a-ac87-fb9de329b00d with Priority: HIGHEST for action port [ 812.301710] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f979a2e4-5a69-449a-ac87-fb9de329b00d with Priority: HIGHEST for action port [ 812.302095] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-f979a2e4-5a69-449a-ac87-fb9de329b00d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.302235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f979a2e4-5a69-449a-ac87-fb9de329b00d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.302305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f979a2e4-5a69-449a-ac87-fb9de329b00d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.302562] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f979a2e4-5a69-449a-ac87-fb9de329b00d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.302654] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f979a2e4-5a69-449a-ac87-fb9de329b00d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.807535] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f979a2e4-5a69-449a-ac87-fb9de329b00d [ 812.807808] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.807908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.807965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.808203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.808323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.808424] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f979a2e4-5a69-449a-ac87-fb9de329b00d already deleted. [ 812.808511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f979a2e4-5a69-449a-ac87-fb9de329b00d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.996342] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: SUCCESS [ 812.996342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.091968] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: SUCCESS [ 813.092473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.143289] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: SUCCESS [ 813.143521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.368303] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: SUCCESS [ 813.368303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.398657] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: SUCCESS [ 813.398885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.219443] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7bf4605f-6c60-469b-8dbd-fc2cecfd890c None None] Enqueued Resource ID: 5aa0b64b-503c-4bdc-8560-be9d94654ffb with Priority: HIGHEST for action port [ 814.222212] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aa0b64b-503c-4bdc-8560-be9d94654ffb with Priority: HIGHEST for action port [ 814.222212] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aa0b64b-503c-4bdc-8560-be9d94654ffb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.222212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aa0b64b-503c-4bdc-8560-be9d94654ffb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.222212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aa0b64b-503c-4bdc-8560-be9d94654ffb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.222212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aa0b64b-503c-4bdc-8560-be9d94654ffb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.222212] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aa0b64b-503c-4bdc-8560-be9d94654ffb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.727447] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5aa0b64b-503c-4bdc-8560-be9d94654ffb [ 814.727708] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.728192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.728343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.728644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.728644] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.728644] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5aa0b64b-503c-4bdc-8560-be9d94654ffb already deleted. [ 814.728782] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aa0b64b-503c-4bdc-8560-be9d94654ffb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.928767] env[69360]: INFO networking_nsxv3.common.synchronization [req-cd3b457f-f206-4206-8992-b8b6ee33c044 req-d99e411c-80f3-4c00-a1de-693adb6d78dc tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 817.928767] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGHEST for action security_group_members [ 817.931061] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.931061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.931061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.931061] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.933113] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.933348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.933434] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.933642] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.933738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.933843] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.437372] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.437372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.437372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.437372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.437372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.437597] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.437597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.437597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.438111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.438111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.438111] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f is going to be updated. [ 818.467317] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.467317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.467528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.467585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.467714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.480650] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: IN_PROGRESS for 2s [ 820.489785] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f in Status: SUCCESS [ 820.489785] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f deletion is rescheduled due to dependency. [ 820.489785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.504300] env[69360]: INFO networking_nsxv3.common.synchronization [None req-77dd044c-b827-4062-9934-71181200801d None None] Enqueued Resource ID: 2638bd62-6d23-44fc-920b-e033ed3ee907 with Priority: HIGHEST for action port [ 820.504300] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2638bd62-6d23-44fc-920b-e033ed3ee907 with Priority: HIGHEST for action port [ 820.504300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2638bd62-6d23-44fc-920b-e033ed3ee907 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.504300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2638bd62-6d23-44fc-920b-e033ed3ee907" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.504300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2638bd62-6d23-44fc-920b-e033ed3ee907" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.504300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2638bd62-6d23-44fc-920b-e033ed3ee907" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.504300] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2638bd62-6d23-44fc-920b-e033ed3ee907',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.007220] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2638bd62-6d23-44fc-920b-e033ed3ee907 [ 821.007220] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.007220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.007220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.007220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.007220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.007220] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2638bd62-6d23-44fc-920b-e033ed3ee907 already deleted. [ 821.007220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2638bd62-6d23-44fc-920b-e033ed3ee907" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.252927] env[69360]: INFO networking_nsxv3.common.synchronization [req-0bfe79aa-15cb-4630-92d3-2de33fe7c748 req-d358ad9c-825e-4da6-a046-f433655deb7b tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 821.253539] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGHEST for action security_group_members [ 821.253850] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.253964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.254046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.254242] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.254431] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.254526] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.254583] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.254724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.254806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.254897] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.380375] env[69360]: INFO networking_nsxv3.common.synchronization [None req-02e36e31-636e-47b1-a783-bd55ef29c46d tempest-ServerActionsTestOtherB-179286054 tempest-ServerActionsTestOtherB-179286054-project-member] Enqueued Resource ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 with Priority: HIGHEST for action security_group_rules [ 821.380944] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 with Priority: HIGHEST for action security_group_rules [ 821.381272] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070c902f-5b72-4abe-9b33-d51deccbf7f7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.381425] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.381463] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.381698] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.381802] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070c902f-5b72-4abe-9b33-d51deccbf7f7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.501073] env[69360]: INFO networking_nsxv3.common.synchronization [None req-50f122f1-4ff0-4c41-94a1-4b46fc75b584 tempest-ServerActionsTestOtherB-179286054 tempest-ServerActionsTestOtherB-179286054-project-member] Enqueued Resource ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 with Priority: HIGHEST for action security_group_rules [ 821.501073] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 with Priority: HIGHEST for action security_group_rules [ 821.501697] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-070c902f-5b72-4abe-9b33-d51deccbf7f7 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.501697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.758239] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.758437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.758493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.758714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.758810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.759114] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.759114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.759239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.759317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.759394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.759487] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 is going to be updated. [ 821.795487] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.795785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.796065] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.796251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.805723] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: IN_PROGRESS for 2s [ 821.904252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.904252] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 already deleted. [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.904252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.904252] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('070c902f-5b72-4abe-9b33-d51deccbf7f7',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.428764] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.428930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.428997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.429236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.429333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.429433] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 070c902f-5b72-4abe-9b33-d51deccbf7f7 already deleted. [ 822.429517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-070c902f-5b72-4abe-9b33-d51deccbf7f7" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.696736] env[69360]: INFO networking_nsxv3.common.synchronization [None req-db417136-f35f-4426-9774-fcc75b47d1ea None None] Enqueued Resource ID: 77668b0b-21f3-45ac-91ca-df5729e029e5 with Priority: HIGHEST for action port [ 822.697048] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77668b0b-21f3-45ac-91ca-df5729e029e5 with Priority: HIGHEST for action port [ 822.697305] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-77668b0b-21f3-45ac-91ca-df5729e029e5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.697452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77668b0b-21f3-45ac-91ca-df5729e029e5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.697499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77668b0b-21f3-45ac-91ca-df5729e029e5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.697768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77668b0b-21f3-45ac-91ca-df5729e029e5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.697849] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77668b0b-21f3-45ac-91ca-df5729e029e5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.202574] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77668b0b-21f3-45ac-91ca-df5729e029e5 [ 823.202707] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.202841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.202936] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.203227] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.203350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.203497] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77668b0b-21f3-45ac-91ca-df5729e029e5 already deleted. [ 823.203621] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77668b0b-21f3-45ac-91ca-df5729e029e5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.816431] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 in Status: SUCCESS [ 823.816818] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 deletion is rescheduled due to dependency. [ 823.816818] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.963781] env[69360]: INFO networking_nsxv3.common.synchronization [req-17171b96-ca57-47e5-925e-adb21efe7e04 req-a254de4a-94b5-43aa-9580-7b502f342a58 tempest-ServerRescueTestJSON-1132992793 tempest-ServerRescueTestJSON-1132992793-project-member] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 823.964364] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGHEST for action security_group_members [ 823.964705] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.964942] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.965034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.965259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.965418] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.965543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.965607] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.965728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.965813] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.965920] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.467968] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.468127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.468127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.468374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.468374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.468581] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.468678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.468741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.468883] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.468959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.469059] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf is going to be updated. [ 824.496785] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.497021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.497021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.497348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.497916] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.506680] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: IN_PROGRESS for 2s [ 826.517808] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93cab96c-004c-44eb-9939-8484814e8bbf in Status: SUCCESS [ 826.518513] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf deletion is rescheduled due to dependency. [ 826.518747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.968605] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-717888d8-4762-4663-83bf-3db376cabae0 tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 826.969129] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 826.969471] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.969564] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.969614] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.969850] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.970181] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.970181] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.970359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.970359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.970444] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.970560] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.294482] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-4cacf43d-460f-443e-bb80-fed652e945f4 tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 827.294976] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 827.295288] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.295394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.472575] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.472722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.472792] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.473028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.473136] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.473334] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.473428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.473492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.473635] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.473706] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.473786] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 already deleted. [ 827.473863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.474029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.474170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.474303] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.474391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.474445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.474576] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.474677] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.474728] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.578080] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-2008ac56-1e04-48fc-b629-60f60b11e84a tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 827.578604] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 827.578902] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.579016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.865443] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-597 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.865443] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.865443] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.865443] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.866053] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.866053] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.866235] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.866461] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.866813] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.866813] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.866931] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.867060] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.867178] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.867293] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 827.867510] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.867556] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.886219] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.886395] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 827.886591] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.886712] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.887057] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.887434] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.887434] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.887672] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.887823] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7485ac3f-c5a1-4b84-a33a-afb79101e2e9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.977409] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.977593] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.977666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.977887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.977985] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978197] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.978296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.978357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.978505] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.978584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978670] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 already deleted. [ 827.978751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.978930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.979085] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.979227] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.979322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.979379] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.979518] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.979594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.979686] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.390147] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.390362] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.390577] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.390941] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.391088] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.391230] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 not found, creating... [ 828.391520] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.391686] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.391809] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.392089] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.392238] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.392523] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.392681] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.392803] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.393026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.393183] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.393930] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 is going to be created. [ 828.414394] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.414722] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.414722] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.414984] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.415236] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.415468] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.482330] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.482549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.482549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.482825] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.482934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.483200] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.483321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.483386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.483552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.483633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.483720] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 already deleted. [ 828.483809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.269130] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-4852e6f4-89fb-4a2c-a2b3-341d5c60e628 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 829.269435] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-4852e6f4-89fb-4a2c-a2b3-341d5c60e628 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 829.269488] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-4852e6f4-89fb-4a2c-a2b3-341d5c60e628 service nova] Enqueued Resource ID: 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 with Priority: HIGHEST for action port [ 829.269695] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 829.269820] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 829.269916] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 with Priority: HIGHEST for action port [ 829.270615] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.270746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.270800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.271108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.271210] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.272592] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.272710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.272778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.272974] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.273162] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.273332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.273332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.273468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.273553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.273644] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.274525] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.274693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.274693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.274779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.274844] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7485ac3f-c5a1-4b84-a33a-afb79101e2e9',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.462786] env[69360]: INFO networking_nsxv3.common.synchronization [req-eab4171b-3d9a-4448-8ae3-e7d8a431472b req-4b1b8a7b-6595-499c-8d8c-137a70826b33 tempest-ImagesTestJSON-957163409 tempest-ImagesTestJSON-957163409-project-member] Enqueued Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 829.463461] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 829.463799] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.463951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.464121] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.464411] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.464601] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.464729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.464809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.464984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.465109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.465223] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.737656] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.737859] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-720" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.737989] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-720" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.738343] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-720" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.738644] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.738759] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.738873] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.739134] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.739258] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.739469] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.739666] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.739802] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.739935] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.740113] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.740241] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.740376] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.760046] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.760046] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.760046] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.760046] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-720" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.760287] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-78c06e71-f193-4afd-bc2a-6864911de0ff taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.760375] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.760498] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.760765] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.760907] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c06e71-f193-4afd-bc2a-6864911de0ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.776612] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.776702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.776871] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.777986] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 with status ACTIVE [ 829.782020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.782020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.782020] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.782020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.782020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7485ac3f-c5a1-4b84-a33a-afb79101e2e9 is going to be updated. [ 829.802469] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.802469] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.802662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.803480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.803480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.803480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7485ac3f-c5a1-4b84-a33a-afb79101e2e9" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.967309] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.967481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.967681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.967967] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.968237] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.968237] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.968426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.968516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.968743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.968872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.968934] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 already deleted. [ 829.969047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.070641] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-982 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.070900] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-982" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.071075] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-982" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.072750] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-982" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.073166] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.075282] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.075282] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.075282] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.075282] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.075282] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.075282] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.075282] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.075282] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.075282] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 830.075282] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.075901] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.098868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.098868] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 830.098868] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.098868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-982" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.098868] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-19be5951-2642-49af-aaa5-d15bc24f0434 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.098868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.098868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.098868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.099699] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19be5951-2642-49af-aaa5-d15bc24f0434',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.263717] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.263949] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.264094] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.264440] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.264630] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.264775] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 78c06e71-f193-4afd-bc2a-6864911de0ff not found, creating... [ 830.265053] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.265221] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.265342] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.265572] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.265710] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.265991] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.266174] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.266299] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.266866] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.267050] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.267205] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 78c06e71-f193-4afd-bc2a-6864911de0ff is going to be created. [ 830.282317] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.288721] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.288972] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.289156] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.289408] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.289699] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.289938] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.603042] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.603042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.603042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.603042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.603042] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.603337] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 19be5951-2642-49af-aaa5-d15bc24f0434 not found, creating... [ 830.603513] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.603707] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.603801] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.604081] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.604231] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.604536] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.604697] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.604818] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.605036] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.605188] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.605337] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 19be5951-2642-49af-aaa5-d15bc24f0434 is going to be created. [ 830.625423] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.626127] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.626127] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.626127] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.626298] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.626478] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.785897] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.786088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.786163] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.786375] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.786466] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.786567] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be created. [ 830.823726] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.823900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.823943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.824186] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.824356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.836484] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: UNINITIALIZED for 2s [ 831.002550] env[69360]: INFO networking_nsxv3.common.synchronization [req-eab4171b-3d9a-4448-8ae3-e7d8a431472b req-29782478-3112-43a6-bee6-7bd45193c81b service nova] Enqueued Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_rules [ 831.002550] env[69360]: INFO networking_nsxv3.common.synchronization [req-eab4171b-3d9a-4448-8ae3-e7d8a431472b req-29782478-3112-43a6-bee6-7bd45193c81b service nova] Enqueued Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 831.002629] env[69360]: INFO networking_nsxv3.common.synchronization [req-eab4171b-3d9a-4448-8ae3-e7d8a431472b req-29782478-3112-43a6-bee6-7bd45193c81b service nova] Enqueued Resource ID: 78c06e71-f193-4afd-bc2a-6864911de0ff with Priority: HIGHEST for action port [ 831.002795] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_rules [ 831.003024] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 831.003147] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78c06e71-f193-4afd-bc2a-6864911de0ff with Priority: HIGHEST for action port [ 831.003704] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.003824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.003895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.004148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.004241] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.005431] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.005563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.005628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.005769] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.005913] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.006015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.006078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.006211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.006294] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.006379] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.007098] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-78c06e71-f193-4afd-bc2a-6864911de0ff taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.007219] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.007288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.007434] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.007513] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78c06e71-f193-4afd-bc2a-6864911de0ff',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.402403] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-43359aba-fe38-46a0-90bc-a5e43805466e service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 831.402672] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-43359aba-fe38-46a0-90bc-a5e43805466e service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 831.402789] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-43359aba-fe38-46a0-90bc-a5e43805466e service nova] Enqueued Resource ID: 19be5951-2642-49af-aaa5-d15bc24f0434 with Priority: HIGHEST for action port [ 831.403439] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 831.403564] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 831.403666] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19be5951-2642-49af-aaa5-d15bc24f0434 with Priority: HIGHEST for action port [ 831.403944] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.404081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.404300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.404387] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.404563] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-19be5951-2642-49af-aaa5-d15bc24f0434 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.404664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.404727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.404929] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.405014] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19be5951-2642-49af-aaa5-d15bc24f0434',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.509596] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.509759] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.509950] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.510989] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78c06e71-f193-4afd-bc2a-6864911de0ff with status ACTIVE [ 831.511211] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.511354] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.511456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.511602] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.511696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.511933] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.512088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.512189] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.512391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.512476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.512674] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.512852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.512852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.512958] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.513051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.513169] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78c06e71-f193-4afd-bc2a-6864911de0ff is going to be updated. [ 831.534453] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.534969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.534969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.534969] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.535166] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.535341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78c06e71-f193-4afd-bc2a-6864911de0ff" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.906861] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19be5951-2642-49af-aaa5-d15bc24f0434 with status ACTIVE [ 831.907215] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.907400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.907481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.907695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.907791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.907969] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.909026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.909026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.909026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.909191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.909227] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.909324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.909387] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.909534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.909652] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.909775] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19be5951-2642-49af-aaa5-d15bc24f0434 is going to be updated. [ 831.932160] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.932407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.932645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.932821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.932965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.933146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19be5951-2642-49af-aaa5-d15bc24f0434" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.015829] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.340143] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-597 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.344018] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.344018] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.344018] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.344018] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.344018] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.344018] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.344018] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.344018] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.344018] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.361515] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.361846] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.361846] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.362014] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-597" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.362457] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-645e6040-4204-42a3-8600-608066c94ade taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.362665] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.362791] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.364252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.364531] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645e6040-4204-42a3-8600-608066c94ade',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.518314] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.518632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.518632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.518758] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.519072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.519072] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 is going to be created. [ 832.547494] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.547686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.547686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.547867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.547993] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.557734] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: UNINITIALIZED for 2s [ 832.846616] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 832.847906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.847906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.847906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.847906] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.847906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.847906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.848352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.848352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.848352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.848352] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.849111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.849289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.850668] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.850668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.850668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.850668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.850668] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.850668] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.867157] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.867379] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.867543] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.867823] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.867978] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.868154] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 645e6040-4204-42a3-8600-608066c94ade not found, creating... [ 832.868424] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.868586] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.868705] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.868934] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.869129] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.869501] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.869597] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.869680] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.869888] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.870113] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.870284] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 645e6040-4204-42a3-8600-608066c94ade is going to be created. [ 832.891947] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.892255] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.892390] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.892669] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.892903] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.893194] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.351676] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.351951] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.352085] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.841754] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-202fb7f2-703e-46e8-a9c1-8c8145bdc306 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 833.842095] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-202fb7f2-703e-46e8-a9c1-8c8145bdc306 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 833.842245] env[69360]: INFO networking_nsxv3.common.synchronization [req-361d6c1a-76ca-4e60-9627-03c3bebad406 req-202fb7f2-703e-46e8-a9c1-8c8145bdc306 service nova] Enqueued Resource ID: 645e6040-4204-42a3-8600-608066c94ade with Priority: HIGHEST for action port [ 833.842414] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 833.842559] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 833.842659] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645e6040-4204-42a3-8600-608066c94ade with Priority: HIGHEST for action port [ 833.843328] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.843482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.843646] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.843734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.843954] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-645e6040-4204-42a3-8600-608066c94ade taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.844060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.844118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.844296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.844380] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645e6040-4204-42a3-8600-608066c94ade',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.854621] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.341216] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-7f3e93eb-d930-4c21-81ec-11878fb84c5e tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 834.341775] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 834.342132] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.342270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.342337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.342577] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.342734] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.342835] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.342923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.343044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.343134] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.343230] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.346597] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 645e6040-4204-42a3-8600-608066c94ade with status ACTIVE [ 834.346769] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.346887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.346964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.347118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.347200] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.347377] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.347468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.347528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.347669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.347746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.347926] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.348044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.348101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.348222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.348366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.348404] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 645e6040-4204-42a3-8600-608066c94ade is going to be updated. [ 834.363155] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.363348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.363456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.363673] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.363767] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.363881] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 834.368979] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.369144] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.369236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.369628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.369628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.369806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645e6040-4204-42a3-8600-608066c94ade" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.399611] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.399843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.399843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.400099] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.400228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.411417] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 834.567630] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: SUCCESS [ 834.567841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.568021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.568244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.568440] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.568555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.568624] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.568780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.568862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.568950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.569052] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.711529] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.712397] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.712798] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.713239] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.713645] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.714239] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.714518] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.714855] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.715196] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.715518] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.715753] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.716014] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.716269] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.716737] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 834.716977] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.717276] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 834.746026] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 834.746026] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 834.746026] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 834.746026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.746026] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-badee9f4-aebf-4455-81d3-ddbb3adb8072 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.746026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.746026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.746026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.746026] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('badee9f4-aebf-4455-81d3-ddbb3adb8072',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.845430] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.845718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.845718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.845882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.845987] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.846191] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.846285] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.846345] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.846497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.846573] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.846658] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 already deleted. [ 834.846739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.848572] env[69360]: INFO networking_nsxv3.common.synchronization [req-5fd10dcf-a94e-4432-b8c9-227cd572cc3a req-529a7e1e-321d-44fe-8488-d76ce20c81ea tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 834.849218] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGHEST for action security_group_members [ 834.850488] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.850488] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.850488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.850961] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.071422] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.071620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.071620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.071784] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.071955] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.072089] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.072171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.072954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.073111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.073209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.073326] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.073430] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.073502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.073882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.073882] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.073882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.074211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.074211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.074211] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.074413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.074413] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.252577] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.252887] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.252958] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254034] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.254034] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.254034] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port badee9f4-aebf-4455-81d3-ddbb3adb8072 not found, creating... [ 835.254034] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.254534] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.254534] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254651] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.255148] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.255287] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.255487] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.255616] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.255939] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.256062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.256131] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: badee9f4-aebf-4455-81d3-ddbb3adb8072 is going to be created. [ 835.282348] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.282765] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.282871] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.283253] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.283505] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.283751] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.352901] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.353167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.353220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.353419] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.353521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.353728] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.353829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.353890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.354094] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.354176] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.354270] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 is going to be updated. [ 835.416949] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.417240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.417240] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.417388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.417584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.428422] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: IN_PROGRESS for 2s [ 835.577593] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4597f8d6-deda-4e64-918a-928b7361dad2: rpc.has_security_group_logging(os_id): False [ 835.596829] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.597033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.597114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.597378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.597488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.597740] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.597874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.597943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.598156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.598233] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.598461] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.598568] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.598662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.598799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.598890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.599119] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.599276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.599360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.599460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.599543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.599627] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 is going to be created. [ 835.659844] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.660015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.660079] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.660287] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.660536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.675623] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: IN_PROGRESS for 2s [ 836.156681] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-f4ffdef2-c739-45bf-b8fd-01e185a038d7 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 836.157321] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-f4ffdef2-c739-45bf-b8fd-01e185a038d7 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 836.157689] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-f4ffdef2-c739-45bf-b8fd-01e185a038d7 service nova] Enqueued Resource ID: badee9f4-aebf-4455-81d3-ddbb3adb8072 with Priority: HIGHEST for action port [ 836.159181] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 836.159997] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 836.159997] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: badee9f4-aebf-4455-81d3-ddbb3adb8072 with Priority: HIGHEST for action port [ 836.160787] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.163020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.163020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.163020] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.163020] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.164621] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.165147] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.167875] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.167875] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.167875] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-badee9f4-aebf-4455-81d3-ddbb3adb8072 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.167875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.167875] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('badee9f4-aebf-4455-81d3-ddbb3adb8072',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.423348] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 836.423574] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.423752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424453] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.424453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.424453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.424672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.424672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.424774] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.424941] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.425880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.425955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.426145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.426306] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.426410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.426473] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.426634] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.426710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.426800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.426891] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.427838] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.427991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.428155] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.428257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.428328] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.428496] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.428587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.428683] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.665585] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.665731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.671204] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.672218] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port badee9f4-aebf-4455-81d3-ddbb3adb8072 with status ACTIVE [ 836.672423] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.672549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.672619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.672840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.672935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.673134] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.674068] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.674068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.674523] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: badee9f4-aebf-4455-81d3-ddbb3adb8072 is going to be updated. [ 836.697026] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.697026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.697026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.697026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.697026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.697324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-badee9f4-aebf-4455-81d3-ddbb3adb8072" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.931174] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3729e4-b05d-4d6a-8a28-cf87f7fe4240: rpc.has_security_group_logging(os_id): False [ 836.932465] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.950192] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.950384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.950384] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.950612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.950710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.950896] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.950996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.951072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.951231] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.951307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.951494] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.951589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.951589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.951824] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.951862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.952048] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.952273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.952273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.952536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.952536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.952618] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be created. [ 837.017639] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.017639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.017639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.017971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.018097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.030404] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-a74664aa-5912-4be3-ad8f-4b9a8f6874c0 tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 837.030954] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 837.031276] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.031385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.032275] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 837.176020] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.435765] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.438564] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 in Status: SUCCESS [ 837.438848] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 deletion is rescheduled due to dependency. [ 837.439008] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.679930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.680456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.680594] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.680843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.680944] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.681081] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be created. [ 837.695741] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: SUCCESS [ 837.695741] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.707428] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.707620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.707686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.707859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.708036] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.719230] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: UNINITIALIZED for 2s [ 837.816704] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.816918] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.817175] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.817353] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.817912] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.818117] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.818244] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.818480] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.818633] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.818853] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.818973] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 837.819109] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 837.819211] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 837.819327] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 837.819441] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 837.819593] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 837.842475] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 837.842697] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 837.842919] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 837.843196] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.843646] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-4fc784f5-80ec-41ce-bb71-af0e71d38e84 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.843842] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.843975] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.844403] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.844805] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc784f5-80ec-41ce-bb71-af0e71d38e84',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.938489] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.938863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.938863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.939076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.939142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.939212] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 837.972322] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.972542] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.972606] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.972860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.973051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.984296] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 838.347350] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.347717] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.347762] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.348541] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.348541] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.348541] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 4fc784f5-80ec-41ce-bb71-af0e71d38e84 not found, creating... [ 838.348824] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.349040] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.349189] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.349466] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.349624] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.350009] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.350225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.350357] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.350620] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.350789] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.350959] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 4fc784f5-80ec-41ce-bb71-af0e71d38e84 is going to be created. [ 838.376434] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.376731] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.376903] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.377242] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.377517] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.377783] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.053119] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 839.053119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.053119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.053119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.053119] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.102578] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-583cde6f-333f-41f5-83fd-ce2e76fb94f7 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 839.102759] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-583cde6f-333f-41f5-83fd-ce2e76fb94f7 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 839.102899] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-583cde6f-333f-41f5-83fd-ce2e76fb94f7 service nova] Enqueued Resource ID: 4fc784f5-80ec-41ce-bb71-af0e71d38e84 with Priority: HIGHEST for action port [ 839.103161] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 839.103303] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 839.103664] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fc784f5-80ec-41ce-bb71-af0e71d38e84 with Priority: HIGHEST for action port [ 839.103928] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.104098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.104279] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.104332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.104507] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fc784f5-80ec-41ce-bb71-af0e71d38e84 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.104607] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.104672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.104875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.104955] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fc784f5-80ec-41ce-bb71-af0e71d38e84',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.558070] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.558070] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.610033] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fc784f5-80ec-41ce-bb71-af0e71d38e84 with status ACTIVE [ 839.610033] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.610033] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.610033] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.610033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.610033] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fc784f5-80ec-41ce-bb71-af0e71d38e84 is going to be updated. [ 839.637272] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.637457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.637538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.637757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.637904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.638080] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fc784f5-80ec-41ce-bb71-af0e71d38e84" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.690469] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-d5a45a0d-5d70-4ab7-8e0e-4400e0dc838f tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 839.691162] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 839.691539] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.691657] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.733113] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 839.733361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.733569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.733756] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.733951] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.734081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.734147] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.734306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.734387] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.734474] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.734572] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.736059] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.738940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.738940] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.738940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.738940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.738940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.738940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.738940] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.000096] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 840.000220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.000400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.000626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.000829] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.002092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.002092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.002092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.002092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.002092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.002092] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.239095] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.239262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.240700] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.290856] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.291165] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.291312] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.291603] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.291886] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.292149] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.292290] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.292518] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.292672] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.292888] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.293015] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.293166] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.293286] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.293402] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.293511] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.293648] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.324478] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.324763] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 840.324978] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.325279] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-545" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.325532] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-2217ec6c-a6da-4c26-b9de-53239e598080 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.325724] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.325841] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.326212] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.326363] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2217ec6c-a6da-4c26-b9de-53239e598080',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.505619] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.505897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.505897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.506128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.506306] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.506408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.506470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.506618] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.506707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.506795] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.506942] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.507052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.507114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.507251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.507388] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.507478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.507542] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.507678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.507752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.507832] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.507923] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.743930] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.829024] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.829330] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.829534] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.829829] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.830053] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.830299] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 2217ec6c-a6da-4c26-b9de-53239e598080 not found, creating... [ 840.830616] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.830859] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.831062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.831386] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.831587] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.831984] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.832225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.832338] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.832539] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.832667] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.832852] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 2217ec6c-a6da-4c26-b9de-53239e598080 is going to be created. [ 840.870918] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.871115] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.871227] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.871467] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.871710] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.871946] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.010327] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3729e4-b05d-4d6a-8a28-cf87f7fe4240: rpc.has_security_group_logging(os_id): False [ 841.040756] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.040950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.041056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.041248] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.041357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.041563] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.041659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.041737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.041901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.041983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.042282] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.042386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.042479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.042656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.042738] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.043043] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.043188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.043280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.043488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.043595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.043728] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 841.125579] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.125776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.125899] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.126087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.126279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.155231] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 841.246722] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.247176] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.247176] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.247380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.247508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.247711] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 841.280634] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.280634] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.280771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.280897] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.281066] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.294383] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 841.605215] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-35faf2af-3700-4dc6-8dbe-a7bc01e2aeb3 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 841.605790] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-35faf2af-3700-4dc6-8dbe-a7bc01e2aeb3 service nova] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 841.605790] env[69360]: INFO networking_nsxv3.common.synchronization [req-f59be8dc-f5d1-4cae-9cae-d988f44f7986 req-35faf2af-3700-4dc6-8dbe-a7bc01e2aeb3 service nova] Enqueued Resource ID: 2217ec6c-a6da-4c26-b9de-53239e598080 with Priority: HIGHEST for action port [ 841.605790] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_rules [ 841.609123] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 841.609123] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2217ec6c-a6da-4c26-b9de-53239e598080 with Priority: HIGHEST for action port [ 841.609123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.609123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.609123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.609123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.609123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2217ec6c-a6da-4c26-b9de-53239e598080 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.609123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.609123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.609123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.609123] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2217ec6c-a6da-4c26-b9de-53239e598080',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.110906] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2217ec6c-a6da-4c26-b9de-53239e598080 with status ACTIVE [ 842.111289] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.111289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.111388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.111680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.111947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.112228] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.112405] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.112471] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.112790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.112928] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.113167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.113279] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.113350] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.113568] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.113666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.113761] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2217ec6c-a6da-4c26-b9de-53239e598080 is going to be updated. [ 842.141804] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.142098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.142098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.143258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.143258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.143258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2217ec6c-a6da-4c26-b9de-53239e598080" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.306469] env[69360]: INFO networking_nsxv3.common.synchronization [req-1596796d-0651-46e9-83da-c6c399eb51e5 req-91ac521e-db8f-4a7c-9276-81668cdf4733 tempest-ServersNegativeTestJSON-19801240 tempest-ServersNegativeTestJSON-19801240-project-member] Enqueued Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 842.306998] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 842.307344] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.307472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.307538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.307796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.307974] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.308079] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.308128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.308336] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.308403] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.308446] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.651445] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-563 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.651445] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-563" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.651445] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-563" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.651445] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-563" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.651445] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.651445] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.651445] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.654924] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.655225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.655564] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.655785] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.656361] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.656968] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.657277] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 842.657543] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.657781] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.678920] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.678920] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 842.678920] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.678920] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-563" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.678920] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.678920] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.678920] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.678920] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.678920] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae37b9e-8ee4-4b68-b70f-46238b3bc14e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.811645] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811645] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.811645] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb already deleted. [ 842.811645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.167885] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 843.168267] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.168267] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.168488] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.168583] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.182518] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.182732] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.182863] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.183234] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.183400] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.183560] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e not found, creating... [ 843.183824] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.183990] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.184134] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.184364] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.184940] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.185316] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.185515] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.185644] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.185863] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.186013] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.186171] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e is going to be created. [ 843.216789] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.217177] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.217367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.217695] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.217986] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.218284] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.317105] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 843.317343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.317887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.318160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.318364] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.318482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.318550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.318709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.318791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.318887] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.671294] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.671414] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.671491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.671727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.671896] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.671996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.672138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.672988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.672988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.672988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.672988] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.825700] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.029248] env[69360]: INFO networking_nsxv3.common.synchronization [req-1596796d-0651-46e9-83da-c6c399eb51e5 req-007bd7f3-ffff-434d-9f9b-b22e81e213a2 service nova] Enqueued Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_rules [ 844.029430] env[69360]: INFO networking_nsxv3.common.synchronization [req-1596796d-0651-46e9-83da-c6c399eb51e5 req-007bd7f3-ffff-434d-9f9b-b22e81e213a2 service nova] Enqueued Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 844.029915] env[69360]: INFO networking_nsxv3.common.synchronization [req-1596796d-0651-46e9-83da-c6c399eb51e5 req-007bd7f3-ffff-434d-9f9b-b22e81e213a2 service nova] Enqueued Resource ID: 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e with Priority: HIGHEST for action port [ 844.029915] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_rules [ 844.029915] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 844.030035] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e with Priority: HIGHEST for action port [ 844.031366] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.031366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.031366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.031366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.031366] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.032052] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.032199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.032266] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.032445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.032589] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.032690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.032748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.032895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.032975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.033081] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.034407] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.034527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.034692] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.034802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.034875] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ae37b9e-8ee4-4b68-b70f-46238b3bc14e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.175836] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.176251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.176251] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.176408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.176550] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.176960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.177095] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.177356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.177506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.177872] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.182029] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.182029] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.182029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.182029] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.328726] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.534992] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.537332] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e with status ACTIVE [ 844.537332] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.537332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.537332] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.537559] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.537639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.537889] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.538220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.538403] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.538633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.538764] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.539032] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.539147] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.539215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.539398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.539449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.539543] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ae37b9e-8ee4-4b68-b70f-46238b3bc14e is going to be updated. [ 844.541164] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.541297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.571941] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.572235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.572235] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.572510] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.572657] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.572913] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ae37b9e-8ee4-4b68-b70f-46238b3bc14e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.682789] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3729e4-b05d-4d6a-8a28-cf87f7fe4240: rpc.has_security_group_logging(os_id): False [ 844.714344] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.714624] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.714678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.714962] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.715077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.715323] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.715494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.715607] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.715763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.715843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.716068] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.716178] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.716246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.716416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.716601] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.716960] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.716960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.717113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.717221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.717326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.717413] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 844.823340] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.823556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.823604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.823831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.824016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.831387] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.831649] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.831649] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.831826] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.831919] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.832053] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 844.850703] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 844.926690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.926915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.926964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.927183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.927370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.939911] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 845.037416] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.539830] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.540154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.540190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.540423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.540540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.540670] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb is going to be created. [ 845.565467] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.565726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.565847] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.566247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.566370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.576150] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: UNINITIALIZED for 2s [ 845.722509] env[69360]: INFO networking_nsxv3.common.synchronization [req-a9fc9f3e-763b-488a-b9c5-bd879a01937c req-6c1b40ab-5bc1-4bf8-a8b0-4e9ec0236a8e tempest-AttachInterfacesV270Test-1532147299 tempest-AttachInterfacesV270Test-1532147299-project-member] Enqueued Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 845.723086] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 845.723402] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.723528] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.723596] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.723857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.724032] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.724138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.724202] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.724361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.724447] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.724542] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.227438] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.227591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.227591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.227842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.227914] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.228145] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.228715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.228715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.228715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.228715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.228715] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 already deleted. [ 846.228715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.287903] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.288586] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-531" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.288586] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-531" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.288868] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-531" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.289173] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.289328] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.289553] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.289688] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.289836] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.290114] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.290258] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.290394] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.290519] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.290625] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.290786] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.290940] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.314806] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.314806] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.314806] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.314806] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-531" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.314806] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-783fd02a-aef2-4f21-aebf-723120f844c2 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.318983] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.318983] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.318983] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.318983] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('783fd02a-aef2-4f21-aebf-723120f844c2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.439883] env[69360]: INFO networking_nsxv3.common.synchronization [req-06c99624-611a-4647-83e6-7287799f4e14 req-055d3202-5058-4f8b-990a-27af987624b4 tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.442385] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.447915] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.447915] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.447915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.447915] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.726970] env[69360]: INFO networking_nsxv3.common.synchronization [req-06c99624-611a-4647-83e6-7287799f4e14 req-e1be8191-4cd6-40db-b7e8-077f19d5944c tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.727655] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.728167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.728255] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.819883] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.820241] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.820377] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.820665] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.820827] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.820995] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 783fd02a-aef2-4f21-aebf-723120f844c2 not found, creating... [ 846.821286] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.821442] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.821565] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.821787] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.821926] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.822318] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.824364] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.824530] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.824839] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.825026] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.825244] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 783fd02a-aef2-4f21-aebf-723120f844c2 is going to be created. [ 846.852738] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.852738] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.852738] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.852738] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.852738] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.852738] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.872584] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 846.873313] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.934251] env[69360]: INFO networking_nsxv3.common.synchronization [req-06c99624-611a-4647-83e6-7287799f4e14 req-04ec1343-79ae-414f-9f75-a5e8caa471db tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.934809] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 846.935302] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.935468] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.950942] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.960830] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 846.961123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.961699] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.961990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.962353] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.962520] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.962637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.962849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.962978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.963154] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.454487] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.469869] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.586557] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: SUCCESS [ 847.587405] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.587405] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.587405] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.588142] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.588142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.588142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.588303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.588303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.588449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.588759] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.681382] env[69360]: INFO networking_nsxv3.common.synchronization [req-a9fc9f3e-763b-488a-b9c5-bd879a01937c req-71e12b23-37cc-4b2a-aa97-abd31ff51663 service nova] Enqueued Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_rules [ 847.681382] env[69360]: INFO networking_nsxv3.common.synchronization [req-a9fc9f3e-763b-488a-b9c5-bd879a01937c req-71e12b23-37cc-4b2a-aa97-abd31ff51663 service nova] Enqueued Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 847.681382] env[69360]: INFO networking_nsxv3.common.synchronization [req-a9fc9f3e-763b-488a-b9c5-bd879a01937c req-71e12b23-37cc-4b2a-aa97-abd31ff51663 service nova] Enqueued Resource ID: 783fd02a-aef2-4f21-aebf-723120f844c2 with Priority: HIGHEST for action port [ 847.681884] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_rules [ 847.682141] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 847.682276] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 783fd02a-aef2-4f21-aebf-723120f844c2 with Priority: HIGHEST for action port [ 847.682628] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.682811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.682903] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.683297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.683419] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.684784] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.688428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.688492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.688821] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.688958] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.689124] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.689210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.689389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.689506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.689633] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.690769] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-783fd02a-aef2-4f21-aebf-723120f844c2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.694241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.694241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.694241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.694241] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('783fd02a-aef2-4f21-aebf-723120f844c2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.957055] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.957055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.957055] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.957479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.957479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.957479] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 847.975299] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.992260] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.992260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.992260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.992260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.992260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.003690] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 848.091604] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.091840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.092339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.092339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.092560] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.092708] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.092777] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.092979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.093109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.093232] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.093430] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.093529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.093611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.093766] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.093940] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.094057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.094135] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.094316] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.094554] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.094804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.094968] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.194449] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.194637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.196428] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.196428] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 783fd02a-aef2-4f21-aebf-723120f844c2 with status ACTIVE [ 848.196428] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.196428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.196428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.196428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.196428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.196904] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.196904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.196904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.196904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.196904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.197547] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.197547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.197547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.199090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.199090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.199090] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 783fd02a-aef2-4f21-aebf-723120f844c2 is going to be updated. [ 848.232066] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.232307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.232440] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.232723] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.232763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.232927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-783fd02a-aef2-4f21-aebf-723120f844c2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.479694] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.479694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.479694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.479694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.479694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.479694] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 848.521407] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.521407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.521407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.521407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.521407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.532185] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 848.598071] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c4bbd71-985d-4aad-9fb8-708c57945ecb: rpc.has_security_group_logging(os_id): False [ 848.621992] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.622308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.622465] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.622793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.622934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.623288] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.623450] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.623550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.623756] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.623864] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.624208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.624844] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.624994] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.625514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.625613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.625827] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.625933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.625997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.626177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.626283] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.626376] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb is going to be created. [ 848.673044] env[69360]: INFO networking_nsxv3.common.synchronization [None req-568ac7a0-cbf3-4dec-9eff-d9e4cdd9ce09 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 with Priority: HIGHEST for action security_group_rules [ 848.673739] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 with Priority: HIGHEST for action security_group_rules [ 848.675322] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.675322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.675322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.675322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.675322] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('203e7f1b-9ea0-44fe-88e0-9f33d5773f39',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.701741] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.721029] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.721029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.721029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.721029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.721029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.740743] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: IN_PROGRESS for 2s [ 848.814201] env[69360]: INFO networking_nsxv3.common.synchronization [None req-7bfdaa78-9ef9-47e2-947b-d405a6f3d0a1 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 with Priority: HIGHEST for action security_group_rules [ 848.814201] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 with Priority: HIGHEST for action security_group_rules [ 848.815444] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.816341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.204341] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.204879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.204879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.205038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.205130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.205234] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 is going to be created. [ 849.210307] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.210307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.210307] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.210511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.210543] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.210626] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 already deleted. [ 849.210725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.210877] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.211157] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.211294] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('203e7f1b-9ea0-44fe-88e0-9f33d5773f39',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.243207] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.243433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.243514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.243765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.243965] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.258293] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: UNINITIALIZED for 2s [ 849.741237] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.741423] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.741531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.741830] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.741931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.742042] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 203e7f1b-9ea0-44fe-88e0-9f33d5773f39 already deleted. [ 849.742154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-203e7f1b-9ea0-44fe-88e0-9f33d5773f39" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.014774] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 850.015097] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.015320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.015556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.015805] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.015955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.016069] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.017648] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.017648] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.017648] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.520097] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.520395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.520395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.520572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.520671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.521159] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.521159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.521159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.521300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.521300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.521490] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 850.546220] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.550024] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550024] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.550024] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.550024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.550905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.550905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.550905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.550905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.551044] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.551946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.552244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.552385] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.552529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.552707] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.552765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.552854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.552924] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.555979] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.556113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.556179] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.556344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.556476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.566941] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 850.753765] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: SUCCESS [ 850.754008] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.056043] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fff936-6194-4f2d-9259-4eed178abd53: rpc.has_security_group_logging(os_id): False [ 851.058091] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.075041] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.075303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.075498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.076402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.076545] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.076845] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.076955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077053] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.077213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.077298] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.077502] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.077623] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077679] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.077839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.077910] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.079147] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.079288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.079376] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.079557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.079666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.079789] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be created. [ 851.148243] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.148243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.148243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.148243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.148557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.162754] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 851.272721] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: SUCCESS [ 851.274049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.274049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.274049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.274295] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.274769] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.275090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.275664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.276301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.276475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.276638] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.561613] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.780745] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.781234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.781234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.781234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.782284] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.782284] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.782284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.782724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.783310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.783310] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.783310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.783310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.783310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.783536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.783536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.783602] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.066157] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.066260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.066407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.066582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.066737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.066820] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 852.101604] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.101604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.101604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.102028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.102122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.113801] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 852.287914] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 662bb1eb-3a7e-4a77-a000-23abf2831625: rpc.has_security_group_logging(os_id): False [ 852.307029] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.307210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.307303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.307632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.307750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.308039] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.308158] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.308291] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.308475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.308555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.308863] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.308971] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.309148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.309556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.309556] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.309821] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.310184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.310286] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.310646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.310742] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.310849] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 is going to be created. [ 852.372199] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.372367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.372367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.372734] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.372932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.386068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: IN_PROGRESS for 2s [ 852.579582] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 852.579923] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 deletion is rescheduled due to dependency. [ 852.579923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.580138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.580408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.580601] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.580739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.580811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.580997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.581109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.581216] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.086821] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.087090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.087221] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.087581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.087760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.088180] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.088236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.088344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.088667] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.088709] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.088823] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 853.128486] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.128486] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.128486] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.128486] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.128486] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.140506] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 853.176845] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 853.177271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.177489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.177841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.177999] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.680212] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.680519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.815994] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.816121] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 854.126476] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.126476] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.126476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.126476] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.400121] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: SUCCESS [ 854.400280] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.629971] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.630177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.630260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.630517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.630699] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.630811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.630916] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.631045] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.631144] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.631223] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.631375] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.631480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.631540] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.631689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.631831] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.631978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.631978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.632167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.632281] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.632358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.632481] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.694068] env[69360]: INFO networking_nsxv3.common.synchronization [req-9b5e4fb4-e357-4ec1-97d9-90f67718b83d req-e026bd73-1e40-4109-b7ea-ec89abda8e6c tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 854.694068] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 854.694068] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.694068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.694068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.694068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.694757] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.694757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.694757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.694757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.694757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.694757] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.136060] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fff936-6194-4f2d-9259-4eed178abd53: rpc.has_security_group_logging(os_id): False [ 855.152339] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 855.152339] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 deletion is rescheduled due to dependency. [ 855.152339] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.154900] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.155123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.155305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.155645] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.155744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.156132] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.156260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.156345] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.156565] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.156565] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.156750] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.156856] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.156923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.157083] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.157185] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.157399] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.157504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.157569] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.157836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.157836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.157836] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 855.197356] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.223561] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.223867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.223867] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.224117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.224217] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.239618] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 855.700695] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.708509] env[69360]: INFO networking_nsxv3.common.synchronization [None req-8659813f-c21c-49bc-a0a1-47633d88bad8 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: 49ed5902-8517-40f0-91a2-9822ef49d30f with Priority: HIGHEST for action security_group_rules [ 855.708509] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49ed5902-8517-40f0-91a2-9822ef49d30f with Priority: HIGHEST for action security_group_rules [ 855.708809] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49ed5902-8517-40f0-91a2-9822ef49d30f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.708940] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.709019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.709669] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.709760] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49ed5902-8517-40f0-91a2-9822ef49d30f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.807496] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f04f337b-5104-401e-a1ef-06515c380c87 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: 49ed5902-8517-40f0-91a2-9822ef49d30f with Priority: HIGHEST for action security_group_rules [ 855.809371] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49ed5902-8517-40f0-91a2-9822ef49d30f with Priority: HIGHEST for action security_group_rules [ 855.809371] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49ed5902-8517-40f0-91a2-9822ef49d30f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.809371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.203950] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.203950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.203950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.204322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.204457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.204620] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 856.233990] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.233990] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49ed5902-8517-40f0-91a2-9822ef49d30f already deleted. [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.233990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.233990] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49ed5902-8517-40f0-91a2-9822ef49d30f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.242647] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.242884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.242884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.243106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.243284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.255089] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 856.757842] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.757842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.757842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.758334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.758334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.758334] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49ed5902-8517-40f0-91a2-9822ef49d30f already deleted. [ 856.758334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49ed5902-8517-40f0-91a2-9822ef49d30f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.259761] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 857.259926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.260098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.260300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.260411] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.763177] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.763585] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.266602] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 858.267075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.267213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.267554] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.267853] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.268042] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.268148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.268393] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.268522] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.268677] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.268839] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.771740] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.772118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.772118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.772400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.772689] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.772848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.772918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.773137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.773278] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.773372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.773538] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.773641] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.773705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.773860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.774016] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.774119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.774185] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.774344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.774401] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.774502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.774595] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.279166] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0fff936-6194-4f2d-9259-4eed178abd53: rpc.has_security_group_logging(os_id): False [ 859.295874] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.296156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.296690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.296690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.296690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.296690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.298933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.298933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.298933] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.298933] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 859.371531] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.371693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.371754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.371989] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.372335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.390789] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 860.808621] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 860.808995] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 861.407020] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 861.407249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.583775] env[69360]: INFO networking_nsxv3.common.synchronization [req-4dc2f4c5-b530-43f5-82af-dd384731d332 req-15145439-b434-42d6-9956-2bfeeea188b1 tempest-AttachInterfacesV270Test-1532147299 tempest-AttachInterfacesV270Test-1532147299-project-member] Enqueued Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 863.584843] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGHEST for action security_group_members [ 863.584843] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.584843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.584843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.585175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.585306] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.585450] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.585536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.585894] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.586033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.586170] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.089123] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.089397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.089448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.089725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.089852] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.090093] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.090225] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.090333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.090537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.090632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.090727] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 is going to be updated. [ 864.120632] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.120845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.120845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.120994] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.121165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.131222] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: IN_PROGRESS for 2s [ 866.143153] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 in Status: SUCCESS [ 866.143509] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 deletion is rescheduled due to dependency. [ 866.143509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.585378] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 868.585668] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 873.586799] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 873.587707] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 878.588559] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 878.588876] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 880.808413] env[69360]: INFO networking_nsxv3.common.synchronization [None req-563886b1-b348-426f-8f52-10808530efe9 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 880.812154] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 880.812154] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.812154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.812154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.812154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.812154] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.908711] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6f5352ed-f6df-4307-8f7b-2a2651afaa47 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 880.908880] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 880.909207] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.909435] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.335550] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.335550] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5779f8c2-8142-43f8-8700-67010b902abd already deleted. [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.335550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.335550] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.857243] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.857550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.857550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.857620] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.857653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.858403] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5779f8c2-8142-43f8-8700-67010b902abd already deleted. [ 881.858403] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.911031] env[69360]: INFO networking_nsxv3.common.synchronization [req-775ed4e5-8bd2-4d2c-8d8d-3e33cb192c86 req-65233b37-1822-41ab-ba57-72d8b9b565eb tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 884.911031] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 884.911651] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.912038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.912352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.915023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.915023] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.915023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.915023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.915023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.915023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.915023] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.918162] env[69360]: INFO networking_nsxv3.common.synchronization [req-a6fb10fd-5288-49e0-b35b-8dedcaa9fd7f req-7b5d0c0a-5f58-45bc-afce-58edd9490c83 tempest-ListServersNegativeTestJSON-1734614987 tempest-ListServersNegativeTestJSON-1734614987-project-member] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 884.919464] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGHEST for action security_group_members [ 884.919984] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.920348] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.420445] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.420646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.420646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.420846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.420947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.421163] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.421263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.421327] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.421472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.421550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.421636] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 885.452025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.452025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.452025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.452025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.452025] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.461575] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 886.557219] env[69360]: INFO networking_nsxv3.common.synchronization [req-9920216c-2ae6-4fb7-81d0-fbadfd2aa9c5 req-5c864628-9be2-4c97-92a3-7a9f631a818e tempest-ServersNegativeTestJSON-19801240 tempest-ServersNegativeTestJSON-19801240-project-member] Enqueued Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 886.558049] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGHEST for action security_group_members [ 886.558049] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.558210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.558247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.558463] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.558655] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.558758] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.558809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.559755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.559755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.559755] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.062171] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.062352] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.062481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.062710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.062849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.063076] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.063180] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.063246] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.063428] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.063534] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.063652] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb is going to be updated. [ 887.091959] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.092231] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.092290] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.092502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.092810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.102519] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: IN_PROGRESS for 2s [ 887.472673] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 887.472903] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 deletion is rescheduled due to dependency. [ 887.473183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.473183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.473381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.473564] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.473678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.473747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.473901] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.473985] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.474094] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.976560] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.976964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.976964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.976964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.977085] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.977218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.977323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.977388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.977571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.977631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.977706] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be updated. [ 888.002087] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.003029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.003029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.003029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.003029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.011560] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: IN_PROGRESS for 2s [ 889.115290] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb in Status: SUCCESS [ 889.115627] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb deletion is rescheduled due to dependency. [ 889.115627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.021881] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0fff936-6194-4f2d-9259-4eed178abd53 in Status: SUCCESS [ 890.021881] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 deletion is rescheduled due to dependency. [ 890.021881] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.559549] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 891.559549] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 893.970975] env[69360]: INFO networking_nsxv3.common.synchronization [req-df9d3f41-569a-4508-a654-1d82f08ee23b req-87e6e72b-fc54-419f-a1cb-fd080db3c0e6 tempest-ImagesTestJSON-957163409 tempest-ImagesTestJSON-957163409-project-member] Enqueued Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 893.971500] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGHEST for action security_group_members [ 893.972363] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.972494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.972563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.973839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.974026] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.974137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.974203] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.974612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.974612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.974612] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.095682] env[69360]: INFO networking_nsxv3.common.synchronization [None req-19dc6d81-6570-4383-b8a2-5136aa2bbf32 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: b264f23a-c205-451a-b07c-62c209b92695 with Priority: HIGHEST for action security_group_rules [ 894.096226] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b264f23a-c205-451a-b07c-62c209b92695 with Priority: HIGHEST for action security_group_rules [ 894.096529] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b264f23a-c205-451a-b07c-62c209b92695 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.096655] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.096723] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.096976] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.097240] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b264f23a-c205-451a-b07c-62c209b92695',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.211534] env[69360]: INFO networking_nsxv3.common.synchronization [None req-dfdff9f2-33b9-4f3a-b7c8-080edbbd0a81 tempest-AttachVolumeNegativeTest-2041104029 tempest-AttachVolumeNegativeTest-2041104029-project-member] Enqueued Resource ID: b264f23a-c205-451a-b07c-62c209b92695 with Priority: HIGHEST for action security_group_rules [ 894.212119] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b264f23a-c205-451a-b07c-62c209b92695 with Priority: HIGHEST for action security_group_rules [ 894.212464] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b264f23a-c205-451a-b07c-62c209b92695 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.212637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.481509] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.481509] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.481509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.481509] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 is going to be updated. [ 894.512912] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.512912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.512912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.512912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.512912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.519996] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: IN_PROGRESS for 2s [ 894.620406] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.620406] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b264f23a-c205-451a-b07c-62c209b92695 already deleted. [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.620406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.620406] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b264f23a-c205-451a-b07c-62c209b92695',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.146224] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.146580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.146580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.146724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.146783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.146932] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b264f23a-c205-451a-b07c-62c209b92695 already deleted. [ 895.146992] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b264f23a-c205-451a-b07c-62c209b92695" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.186716] env[69360]: INFO networking_nsxv3.common.synchronization [None req-b1721fd3-ae09-44da-999b-f26d6fb95aa4 None None] Enqueued Resource ID: 457ccbee-b688-4635-b5e8-7e30f009e207 with Priority: HIGHEST for action port [ 895.187356] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457ccbee-b688-4635-b5e8-7e30f009e207 with Priority: HIGHEST for action port [ 895.187728] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-457ccbee-b688-4635-b5e8-7e30f009e207 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.187941] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457ccbee-b688-4635-b5e8-7e30f009e207" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.188016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457ccbee-b688-4635-b5e8-7e30f009e207" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.190288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457ccbee-b688-4635-b5e8-7e30f009e207" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.190288] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457ccbee-b688-4635-b5e8-7e30f009e207',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.692558] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 457ccbee-b688-4635-b5e8-7e30f009e207 [ 895.692558] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.692558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.692558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.692558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.692558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.692558] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:457ccbee-b688-4635-b5e8-7e30f009e207 already deleted. [ 895.692558] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457ccbee-b688-4635-b5e8-7e30f009e207" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.203419] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-9a8f4957-86eb-4bba-a16c-856a122c4fbe tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 896.205220] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 896.205594] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.205772] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.205806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.206019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.206188] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.206295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.206360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.206516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.206605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.206701] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.535993] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4597f8d6-deda-4e64-918a-928b7361dad2 in Status: SUCCESS [ 896.536334] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 deletion is rescheduled due to dependency. [ 896.539116] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.593322] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-9dfdfe6c-7baf-4ae1-9df4-1a44884f53ab tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 896.594542] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 896.594897] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.595014] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.709220] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.709381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.709451] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.709659] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.709750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.709941] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.710323] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.710449] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.710637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.710718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.710837] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 896.741156] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.741156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.741156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.741156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.741156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.750448] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 896.918655] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.918803] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.918938] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.919297] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.919658] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.919773] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.919845] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.920202] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.920869] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.920869] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.920869] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 896.920869] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 896.921603] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 896.921751] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 896.921875] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 896.922111] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 896.942944] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 896.943164] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 896.943304] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 896.943493] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-292" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.944057] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-64046d9a-7f38-4310-893f-f0a44a81b191 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.944057] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.944252] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.944545] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.944700] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64046d9a-7f38-4310-893f-f0a44a81b191',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.412831] env[69360]: INFO networking_nsxv3.common.synchronization [None req-3da94115-7746-41b8-b37c-35c59a492681 None None] Enqueued Resource ID: 936a6423-f92b-4f49-9261-0233c71dbc2c with Priority: HIGHEST for action port [ 897.413023] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936a6423-f92b-4f49-9261-0233c71dbc2c with Priority: HIGHEST for action port [ 897.415118] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-936a6423-f92b-4f49-9261-0233c71dbc2c taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.415118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936a6423-f92b-4f49-9261-0233c71dbc2c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.415118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936a6423-f92b-4f49-9261-0233c71dbc2c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.415118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936a6423-f92b-4f49-9261-0233c71dbc2c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.415118] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936a6423-f92b-4f49-9261-0233c71dbc2c',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.446470] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.446714] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.446861] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.447343] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.447343] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.447460] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 64046d9a-7f38-4310-893f-f0a44a81b191 not found, creating... [ 897.447726] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.447892] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.448079] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.448342] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.448463] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.448790] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.448970] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.449125] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.449321] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.449460] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.449608] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 64046d9a-7f38-4310-893f-f0a44a81b191 is going to be created. [ 897.471312] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.471529] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.471654] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.471927] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.472273] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.472466] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.919835] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 936a6423-f92b-4f49-9261-0233c71dbc2c [ 897.919835] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.919835] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.919835] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.920260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.920260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.920260] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:936a6423-f92b-4f49-9261-0233c71dbc2c already deleted. [ 897.920260] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936a6423-f92b-4f49-9261-0233c71dbc2c" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.198499] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-752ba202-a15d-4977-9c5d-6cdd49324e97 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 898.198686] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-752ba202-a15d-4977-9c5d-6cdd49324e97 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 898.198836] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-752ba202-a15d-4977-9c5d-6cdd49324e97 service nova] Enqueued Resource ID: 64046d9a-7f38-4310-893f-f0a44a81b191 with Priority: HIGHEST for action port [ 898.199089] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 898.199224] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 898.199322] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64046d9a-7f38-4310-893f-f0a44a81b191 with Priority: HIGHEST for action port [ 898.199948] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.200295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.200356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.200552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.200636] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.202633] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.202760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.203060] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-64046d9a-7f38-4310-893f-f0a44a81b191 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.203196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.203271] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.203482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.203569] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64046d9a-7f38-4310-893f-f0a44a81b191',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.706911] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.707201] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.710978] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64046d9a-7f38-4310-893f-f0a44a81b191 with status ACTIVE [ 898.710978] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.710978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.710978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.711191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.711191] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.711420] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.711492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.711492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.711647] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.711718] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.715023] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.715023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.715023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.715023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.715023] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.715023] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64046d9a-7f38-4310-893f-f0a44a81b191 is going to be updated. [ 898.734936] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.735133] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.735215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.735454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.735627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.735804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64046d9a-7f38-4310-893f-f0a44a81b191" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.759664] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 898.759736] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 deletion is rescheduled due to dependency. [ 898.759792] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.759959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.760333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.760394] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.760507] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.760573] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.760727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.760811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.760906] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.763286] env[69360]: INFO networking_nsxv3.common.synchronization [req-25b42554-9a7c-4b23-a267-bc1739181f2d req-f64e1586-7be1-4743-850f-467727efddf2 tempest-ServersTestJSON-142381119 tempest-ServersTestJSON-142381119-project-member] Enqueued Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 898.763695] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 898.764215] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.764356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.764406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.764721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.764779] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.764860] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.764921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.765142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.765234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.765327] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.216586] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-741 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.216813] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-741" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.216940] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-741" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.217334] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-741" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.217600] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.217759] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.217879] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.218715] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.218930] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.219206] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.219363] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.219507] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.219649] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.219798] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.219941] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.220207] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.244624] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.244624] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.244774] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.244889] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-741" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.245252] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-05366f50-f66d-46a5-8e2c-f3c687488099 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.245504] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.245628] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.245970] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.246109] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05366f50-f66d-46a5-8e2c-f3c687488099',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.264439] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.267930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.267930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.267930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.268297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.268297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.268297] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f already deleted. [ 899.268297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.279216] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-732 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.279826] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-732" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.279826] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-732" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.279927] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-732" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.280128] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.280355] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.280494] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.280824] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.281024] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.281272] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.281422] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.281562] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.281698] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.281837] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.281968] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.282132] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.314483] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.314955] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.315226] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.315505] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-732" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.315923] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.316285] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.316537] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.316997] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.317350] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.750198] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.750551] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.750551] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.750822] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.750976] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.751146] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 05366f50-f66d-46a5-8e2c-f3c687488099 not found, creating... [ 899.751410] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.751567] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.751684] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.751905] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.752062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.752534] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.752717] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.752843] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.753078] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.753224] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.753371] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 05366f50-f66d-46a5-8e2c-f3c687488099 is going to be created. [ 899.769293] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.772720] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.772849] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.772977] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.773314] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.773641] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.773883] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.820907] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.821148] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.821286] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.821586] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.821745] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.821912] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 not found, creating... [ 899.822295] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.822547] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.822680] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.822922] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.823085] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.823453] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.823599] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.823725] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.823947] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.824107] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.824259] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 is going to be created. [ 899.849263] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.849500] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.849714] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.849908] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.850209] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.850432] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.273842] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.273842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.273842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.273842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.273842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.273842] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 900.306575] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.306575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.306575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.306575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.306575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.314706] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [req-25b42554-9a7c-4b23-a267-bc1739181f2d req-cd6181ea-6130-4207-87b2-99658405074b service nova] Enqueued Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_rules [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [req-25b42554-9a7c-4b23-a267-bc1739181f2d req-cd6181ea-6130-4207-87b2-99658405074b service nova] Enqueued Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [req-25b42554-9a7c-4b23-a267-bc1739181f2d req-cd6181ea-6130-4207-87b2-99658405074b service nova] Enqueued Resource ID: 05366f50-f66d-46a5-8e2c-f3c687488099 with Priority: HIGHEST for action port [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_rules [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 900.533346] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05366f50-f66d-46a5-8e2c-f3c687488099 with Priority: HIGHEST for action port [ 900.533346] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.533346] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.533346] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.533346] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.533346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.533891] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.533891] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-05366f50-f66d-46a5-8e2c-f3c687488099 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.533891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.533891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.533891] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.533891] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05366f50-f66d-46a5-8e2c-f3c687488099',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.573059] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-a9db6ca6-0fef-4eb7-8dfc-ef6ec6d9a557 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 900.573059] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-a9db6ca6-0fef-4eb7-8dfc-ef6ec6d9a557 service nova] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 900.573059] env[69360]: INFO networking_nsxv3.common.synchronization [req-a8de2b5c-68bd-4ef3-8e82-8594b852f101 req-a9db6ca6-0fef-4eb7-8dfc-ef6ec6d9a557 service nova] Enqueued Resource ID: e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 with Priority: HIGHEST for action port [ 900.573059] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_rules [ 900.573321] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 900.573321] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 with Priority: HIGHEST for action port [ 900.573546] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.573655] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.573857] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.573944] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.575036] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.575126] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.575197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.575413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.575498] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.035826] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.036119] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.036119] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.037296] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05366f50-f66d-46a5-8e2c-f3c687488099 with status ACTIVE [ 901.037296] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.037296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.037417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.038022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.038022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.038022] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.038022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.038022] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.038234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.038234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.038370] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.038750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.038750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.038750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.038750] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.039110] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05366f50-f66d-46a5-8e2c-f3c687488099 is going to be updated. [ 901.061096] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.061232] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.061288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.061498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.061637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.061799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05366f50-f66d-46a5-8e2c-f3c687488099" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.077544] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 with status ACTIVE [ 901.078131] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.078131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.078131] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.078254] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.078282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.078448] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.078553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.078616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.078765] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.078843] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.079057] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.079128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.079175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.079310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.079386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.079473] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2 is going to be updated. [ 901.116038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.116038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.116263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.116408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.116664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.116837] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8aa72cb-4b5c-4ac1-85d5-60be3f7372b2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.392820] env[69360]: INFO networking_nsxv3.common.synchronization [req-26ec5c0c-f9e7-4ffd-a911-15654e71f770 req-ec5672ee-3780-4d6a-b42a-4761c7e6bdf4 tempest-AttachInterfacesTestJSON-2085020977 tempest-AttachInterfacesTestJSON-2085020977-project-member] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_members [ 901.392820] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_members [ 901.392820] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.392820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.392820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.397959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.397959] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.397959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.397959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.397959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.397959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.397959] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.543571] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.776969] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.777652] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.777771] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.778075] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.778355] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.778519] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.778638] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.778861] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.779015] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.779234] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.779348] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.779458] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.779564] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.779674] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.779779] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.779909] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.799044] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.799044] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.799044] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.799044] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-345" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.799266] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-1daae92e-1898-467c-be43-e8f27bff4242 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.799340] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.799448] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.799752] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.799896] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1daae92e-1898-467c-be43-e8f27bff4242',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.897265] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.897435] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.897509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.897722] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.897817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.898025] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.898128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.898192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.898340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.898415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.898501] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5779f8c2-8142-43f8-8700-67010b902abd already deleted. [ 901.898581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.046016] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.046337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.046337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.046480] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.046579] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.046679] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f is going to be created. [ 902.073333] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.073514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.073554] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.073861] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.073947] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.083647] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: UNINITIALIZED for 2s [ 902.303531] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.303531] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.303745] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.304048] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.304225] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.304422] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 1daae92e-1898-467c-be43-e8f27bff4242 not found, creating... [ 902.304717] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.304882] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.305016] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.305752] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.305752] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.305752] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.305945] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.307062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.307062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.307062] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.307062] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 1daae92e-1898-467c-be43-e8f27bff4242 is going to be created. [ 902.324565] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 902.324998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.325207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.325420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.325607] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.325723] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.325789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.325943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.326034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.326135] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.329840] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.329840] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.330060] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.330218] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.330408] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.330637] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.828728] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.250838] env[69360]: INFO networking_nsxv3.common.synchronization [req-26ec5c0c-f9e7-4ffd-a911-15654e71f770 req-3c1fed5b-1ada-47ae-ae34-22ab2dc6b69b service nova] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 903.251115] env[69360]: INFO networking_nsxv3.common.synchronization [req-26ec5c0c-f9e7-4ffd-a911-15654e71f770 req-3c1fed5b-1ada-47ae-ae34-22ab2dc6b69b service nova] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_members [ 903.251189] env[69360]: INFO networking_nsxv3.common.synchronization [req-26ec5c0c-f9e7-4ffd-a911-15654e71f770 req-3c1fed5b-1ada-47ae-ae34-22ab2dc6b69b service nova] Enqueued Resource ID: 1daae92e-1898-467c-be43-e8f27bff4242 with Priority: HIGHEST for action port [ 903.251412] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_rules [ 903.251540] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGHEST for action security_group_members [ 903.251634] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1daae92e-1898-467c-be43-e8f27bff4242 with Priority: HIGHEST for action port [ 903.253409] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.253539] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.253609] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.253808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.253892] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.254742] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.254956] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.254956] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.255092] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.255561] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.255681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.255748] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.255895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.255985] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.256087] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.256828] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-1daae92e-1898-467c-be43-e8f27bff4242 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.256934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.257105] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.258186] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.258279] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1daae92e-1898-467c-be43-e8f27bff4242',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.331442] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.760237] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.760378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.760558] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.762352] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1daae92e-1898-467c-be43-e8f27bff4242 with status ACTIVE [ 903.763319] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.763319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.763319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.763319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.763319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.763319] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.763319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.763575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.763575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.763575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.763743] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.763838] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.763896] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.764050] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.764146] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.764206] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1daae92e-1898-467c-be43-e8f27bff4242 is going to be updated. [ 903.815035] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.815035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.815035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.815035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.815329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.815329] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1daae92e-1898-467c-be43-e8f27bff4242" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.834348] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.834527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.834676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.834921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.835632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.835632] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 903.919253] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.919458] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.919458] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.919685] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.919842] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.931309] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 904.094309] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: SUCCESS [ 904.094739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.094925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.095165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095365] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.095515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.095589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.095758] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095844] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.096036] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.262985] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.598585] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.598954] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.599122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.599570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.599922] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.600143] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.600250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.600504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.600611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.600717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.600908] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.601015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.601081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.601238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.601471] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.601650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.601777] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.602381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.602381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.602381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.602381] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.765673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.765808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.765884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.767475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.767475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.767475] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5779f8c2-8142-43f8-8700-67010b902abd is going to be created. [ 904.793244] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.793244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.793244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.793519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.793666] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.805680] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: UNINITIALIZED for 2s [ 905.106833] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a911e52-5c7b-4b09-b418-a3af1764116f: rpc.has_security_group_logging(os_id): False [ 905.126789] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.127045] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.127045] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.127283] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.127383] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.127690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.127800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.127873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.128069] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.128159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.128401] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.128527] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.128583] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.128776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.128875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.129133] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.129258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.129324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.129508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.129584] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.129694] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f is going to be created. [ 905.241284] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.241284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.241284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.241284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.241284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.264481] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: IN_PROGRESS for 2s [ 905.944946] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 905.945359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.945649] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.945953] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.946248] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.946510] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.946663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.946917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.953426] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.953426] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.953426] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.953426] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.454778] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.455064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.458306] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.816068] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: SUCCESS [ 906.816475] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.816689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.816920] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.817128] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.817249] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.817317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.817472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.817553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.817640] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.817736] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.960316] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.285450] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: SUCCESS [ 907.285752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.320899] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.464755] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.465130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.465130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.465303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.465387] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.465484] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 907.498078] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.498216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.498216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.498438] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.498589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.508366] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 907.824027] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5779f8c2-8142-43f8-8700-67010b902abd: rpc.has_security_group_logging(os_id): False [ 907.845712] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.846062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.846222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.846499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.846600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.846984] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.847192] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.847392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.848090] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.848498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.848776] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5779f8c2-8142-43f8-8700-67010b902abd is going to be created. [ 907.923014] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.923202] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.923283] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.923498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.923743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.944147] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: IN_PROGRESS for 2s [ 908.255026] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 908.255026] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 909.520216] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 909.520216] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.520603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.520825] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.521090] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.521257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.521257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.521400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.521482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.521617] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.521725] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.521857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.521913] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.522106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.522304] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.522445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.522517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.522662] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.522793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.522880] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.523028] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.957232] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: SUCCESS [ 909.957545] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.025803] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3729e4-b05d-4d6a-8a28-cf87f7fe4240: rpc.has_security_group_logging(os_id): False [ 910.045295] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.045511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.045511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.045733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.045826] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.046045] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.046159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.046228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.046417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.046497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.046692] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.046789] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.046855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.046991] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.047081] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.047281] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.047377] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.047439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.047575] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.047650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.047736] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 910.115976] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.116169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.116290] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.116614] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.116869] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.136984] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 911.668794] env[69360]: INFO networking_nsxv3.common.synchronization [req-c6dcbadb-7650-4ae1-8fea-d19613654f29 req-41ad5b01-02c4-4a32-9e4f-f928eea4f247 tempest-ServersTestJSON-142381119 tempest-ServersTestJSON-142381119-project-member] Enqueued Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 911.669367] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGHEST for action security_group_members [ 911.669757] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.669921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.670125] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.670374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.670572] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.670696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.670772] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.670935] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.671033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.671150] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.153971] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 912.154282] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.154523] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.154812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.154953] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.173318] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.173523] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.173565] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.173751] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.173847] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.174167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.174167] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.174302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.174366] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.174444] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.174627] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f is going to be updated. [ 912.203614] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.203800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.203849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.204114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.204274] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.213378] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: IN_PROGRESS for 2s [ 912.660410] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.660410] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.660410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.660410] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.733323] env[69360]: INFO networking_nsxv3.common.synchronization [req-22a6e440-2f28-49a6-9890-9c7ebb48122d req-13367a5f-1336-436d-afb4-3a7b6c13838d tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 912.734978] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 912.734978] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.736397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.736616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.738567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.738567] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.738567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.738567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.738567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.738567] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.738567] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.162895] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.163365] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.244413] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.323232] env[69360]: INFO networking_nsxv3.common.synchronization [req-22a6e440-2f28-49a6-9890-9c7ebb48122d req-ff18cb3a-104c-453f-99d4-5f48872f4960 tempest-ServersTestMultiNic-606427570 tempest-ServersTestMultiNic-606427570-project-member] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 913.323771] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGHEST for action security_group_members [ 913.325067] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.325176] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.749355] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.232438] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a911e52-5c7b-4b09-b418-a3af1764116f in Status: SUCCESS [ 914.232649] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f deletion is rescheduled due to dependency. [ 914.232769] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.254624] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.254917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.255069] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.255308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.255421] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.255527] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 914.287078] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.287334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.287334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.287516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.287670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.298045] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 916.310311] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 916.310311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.310661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.310661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.310746] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.311904] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.311904] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.311904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.312361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.312361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.312424] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.312455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.312538] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.313498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.313654] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.314252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.314252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.314252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.314252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.314252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.314252] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.815817] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb3729e4-b05d-4d6a-8a28-cf87f7fe4240: rpc.has_security_group_logging(os_id): False [ 916.819597] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.819597] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.819769] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.819846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.819934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.820430] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.820430] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.820430] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.821561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.821561] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.821561] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 916.839021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.839021] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.839021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.839603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.839603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.840922] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.840922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.840922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.840922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.840922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.840922] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.840922] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.841220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.841220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.841301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.841431] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be updated. [ 916.860663] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.860663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.860848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.863498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.863498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.869539] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 916.923325] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.923555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.923639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.923865] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.924033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.943653] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: IN_PROGRESS for 2s [ 918.324484] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 918.324791] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 918.880551] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 918.880551] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 deletion is rescheduled due to dependency. [ 918.880772] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.958940] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 in Status: SUCCESS [ 918.959224] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.063536] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a540b921-0c1f-40c9-a965-f186c103a821 None None] Enqueued Resource ID: e7c309af-c01e-46bb-a725-0f6418edad76 with Priority: HIGHEST for action port [ 920.064290] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c309af-c01e-46bb-a725-0f6418edad76 with Priority: HIGHEST for action port [ 920.064675] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7c309af-c01e-46bb-a725-0f6418edad76 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.065054] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7c309af-c01e-46bb-a725-0f6418edad76" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.065118] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7c309af-c01e-46bb-a725-0f6418edad76" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.065406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7c309af-c01e-46bb-a725-0f6418edad76" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.065462] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7c309af-c01e-46bb-a725-0f6418edad76',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.569498] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7c309af-c01e-46bb-a725-0f6418edad76 [ 920.569498] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.569498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.569498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.569498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.569498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.569498] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7c309af-c01e-46bb-a725-0f6418edad76 already deleted. [ 920.569498] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7c309af-c01e-46bb-a725-0f6418edad76" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.452466] env[69360]: INFO networking_nsxv3.common.synchronization [None req-32790d12-2526-47f5-945d-ee003f67a878 None None] Enqueued Resource ID: 41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f with Priority: HIGHEST for action port [ 922.452919] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f with Priority: HIGHEST for action port [ 922.453740] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.453934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.453934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.456325] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.456325] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.959239] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f [ 922.959471] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.959603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.959672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.960188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.960312] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.960415] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f already deleted. [ 922.960499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41b5e4ec-6b6b-4997-a2f0-b3e5b9f7e27f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.270854] env[69360]: INFO networking_nsxv3.common.synchronization [None req-9770b579-76bd-4cd9-8932-1d5cf28687ff None None] Enqueued Resource ID: 909cb88a-730e-480c-96f5-215b23dd8fd4 with Priority: HIGHEST for action port [ 923.271131] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 909cb88a-730e-480c-96f5-215b23dd8fd4 with Priority: HIGHEST for action port [ 923.271751] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-909cb88a-730e-480c-96f5-215b23dd8fd4 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.271859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-909cb88a-730e-480c-96f5-215b23dd8fd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.271898] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-909cb88a-730e-480c-96f5-215b23dd8fd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.272171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-909cb88a-730e-480c-96f5-215b23dd8fd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.272289] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('909cb88a-730e-480c-96f5-215b23dd8fd4',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.774873] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 909cb88a-730e-480c-96f5-215b23dd8fd4 [ 923.775164] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.775303] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.775369] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.775581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.775667] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.775758] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:909cb88a-730e-480c-96f5-215b23dd8fd4 already deleted. [ 923.775836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-909cb88a-730e-480c-96f5-215b23dd8fd4" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.324917] env[69360]: INFO networking_nsxv3.common.synchronization [None req-76f969b2-d32d-4504-b115-822c3b827df7 tempest-ServerActionsTestJSON-1724285782 tempest-ServerActionsTestJSON-1724285782-project-member] Enqueued Resource ID: 0c538b38-5f51-4112-8610-01999fd9c361 with Priority: HIGHEST for action security_group_rules [ 924.325593] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c538b38-5f51-4112-8610-01999fd9c361 with Priority: HIGHEST for action security_group_rules [ 924.325593] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c538b38-5f51-4112-8610-01999fd9c361 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.325697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.325795] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.327801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.327801] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c538b38-5f51-4112-8610-01999fd9c361',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.464872] env[69360]: INFO networking_nsxv3.common.synchronization [None req-4e3e7303-8c9c-4a95-8146-45c13b791aa0 tempest-ServerActionsTestJSON-1724285782 tempest-ServerActionsTestJSON-1724285782-project-member] Enqueued Resource ID: 0c538b38-5f51-4112-8610-01999fd9c361 with Priority: HIGHEST for action security_group_rules [ 924.465342] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c538b38-5f51-4112-8610-01999fd9c361 with Priority: HIGHEST for action security_group_rules [ 924.465666] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c538b38-5f51-4112-8610-01999fd9c361 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.465754] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.855874] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.855874] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c538b38-5f51-4112-8610-01999fd9c361 already deleted. [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.855874] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.855874] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c538b38-5f51-4112-8610-01999fd9c361',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.379741] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.379884] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.379945] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.380204] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.380300] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.380404] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c538b38-5f51-4112-8610-01999fd9c361 already deleted. [ 925.380490] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c538b38-5f51-4112-8610-01999fd9c361" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.055038] env[69360]: INFO networking_nsxv3.common.synchronization [None req-54b28029-0e82-4159-94b3-d57dd1bbac89 None None] Enqueued Resource ID: c132c748-6d75-48ab-af63-b02bb775d220 with Priority: HIGHEST for action port [ 926.055038] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c132c748-6d75-48ab-af63-b02bb775d220 with Priority: HIGHEST for action port [ 926.055038] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-c132c748-6d75-48ab-af63-b02bb775d220 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.055038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c132c748-6d75-48ab-af63-b02bb775d220" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.055038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c132c748-6d75-48ab-af63-b02bb775d220" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.056694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c132c748-6d75-48ab-af63-b02bb775d220" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.056694] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c132c748-6d75-48ab-af63-b02bb775d220',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.559252] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c132c748-6d75-48ab-af63-b02bb775d220 [ 926.559479] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.559917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.559917] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.560029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.560091] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.560246] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c132c748-6d75-48ab-af63-b02bb775d220 already deleted. [ 926.560408] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c132c748-6d75-48ab-af63-b02bb775d220" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.362968] env[69360]: INFO networking_nsxv3.common.synchronization [None req-0919b1c1-54ee-4f70-9fa9-a65097ed3c36 None None] Enqueued Resource ID: 2ed023e1-0fcb-4e6d-b180-e340be299f7f with Priority: HIGHEST for action port [ 928.363790] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed023e1-0fcb-4e6d-b180-e340be299f7f with Priority: HIGHEST for action port [ 928.365688] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed023e1-0fcb-4e6d-b180-e340be299f7f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.365688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed023e1-0fcb-4e6d-b180-e340be299f7f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.365688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed023e1-0fcb-4e6d-b180-e340be299f7f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.365688] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed023e1-0fcb-4e6d-b180-e340be299f7f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.365688] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed023e1-0fcb-4e6d-b180-e340be299f7f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.869782] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ed023e1-0fcb-4e6d-b180-e340be299f7f [ 928.869782] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.869782] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.869782] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.870021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.871049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.871049] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ed023e1-0fcb-4e6d-b180-e340be299f7f already deleted. [ 928.871049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed023e1-0fcb-4e6d-b180-e340be299f7f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.691675] env[69360]: INFO networking_nsxv3.common.synchronization [None req-29119ff5-14bc-46b8-862b-fa5faf14c516 None None] Enqueued Resource ID: 573b5571-127b-4b28-a89c-dccc87c32a74 with Priority: HIGHEST for action port [ 930.694532] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573b5571-127b-4b28-a89c-dccc87c32a74 with Priority: HIGHEST for action port [ 930.695081] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-573b5571-127b-4b28-a89c-dccc87c32a74 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.695421] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573b5571-127b-4b28-a89c-dccc87c32a74" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.696796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573b5571-127b-4b28-a89c-dccc87c32a74" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.696796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573b5571-127b-4b28-a89c-dccc87c32a74" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.696796] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573b5571-127b-4b28-a89c-dccc87c32a74',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.198868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573b5571-127b-4b28-a89c-dccc87c32a74 [ 931.198868] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.198868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.198868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.198868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.198868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.198868] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573b5571-127b-4b28-a89c-dccc87c32a74 already deleted. [ 931.199341] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573b5571-127b-4b28-a89c-dccc87c32a74" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.695993] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 935.696323] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 935.740832] env[69360]: INFO networking_nsxv3.common.synchronization [None req-f014afb1-3f12-413e-aa43-c84f80ce9dfc None None] Enqueued Resource ID: 405ff281-9dab-484a-9293-d078334ea47a with Priority: HIGHEST for action port [ 935.741114] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 405ff281-9dab-484a-9293-d078334ea47a with Priority: HIGHEST for action port [ 935.741996] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-405ff281-9dab-484a-9293-d078334ea47a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.742129] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-405ff281-9dab-484a-9293-d078334ea47a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.742243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-405ff281-9dab-484a-9293-d078334ea47a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.742509] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-405ff281-9dab-484a-9293-d078334ea47a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.742594] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('405ff281-9dab-484a-9293-d078334ea47a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.247398] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 405ff281-9dab-484a-9293-d078334ea47a [ 936.247398] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.247398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.247398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.247398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.247398] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.247626] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:405ff281-9dab-484a-9293-d078334ea47a already deleted. [ 936.247626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-405ff281-9dab-484a-9293-d078334ea47a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.164246] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a494dccc-3327-4b50-9fdf-534b17be1e0b None None] Enqueued Resource ID: 8eff5038-9a24-4772-8d86-f4aebde17a98 with Priority: HIGHEST for action port [ 938.164246] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eff5038-9a24-4772-8d86-f4aebde17a98 with Priority: HIGHEST for action port [ 938.164816] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eff5038-9a24-4772-8d86-f4aebde17a98 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.165151] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eff5038-9a24-4772-8d86-f4aebde17a98" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.165151] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eff5038-9a24-4772-8d86-f4aebde17a98" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.165809] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eff5038-9a24-4772-8d86-f4aebde17a98" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.165961] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eff5038-9a24-4772-8d86-f4aebde17a98',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.668979] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8eff5038-9a24-4772-8d86-f4aebde17a98 [ 938.669208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.669343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.669437] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.669661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.669753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.669851] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8eff5038-9a24-4772-8d86-f4aebde17a98 already deleted. [ 938.669932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eff5038-9a24-4772-8d86-f4aebde17a98" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.165537] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 943.166074] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 948.166386] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 948.166386] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 953.167293] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 953.167714] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 958.168115] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 958.168468] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 963.169647] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 963.170039] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 968.170762] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 968.171182] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 973.172333] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 973.172677] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 978.173268] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.173701] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 983.174372] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 983.174976] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 988.175690] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 988.176118] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 990.145522] env[69360]: INFO networking_nsxv3.common.synchronization [req-b9f4f522-b6d7-4f38-85cb-70558c9e2e0b req-6b44483f-ee22-4bf9-9ea6-78ec79330a55 tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 990.146090] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGHEST for action security_group_members [ 990.146403] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.146533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.146603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.146800] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.146948] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.147681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.147681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.147681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.147681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.147681] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.654177] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.654504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.654504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.654670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.654737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.654930] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.655075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.656208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.656208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.656208] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.656208] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 is going to be updated. [ 990.697185] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.697420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.697420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.697672] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.697744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.706930] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: IN_PROGRESS for 2s [ 992.717763] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd08a380-9c77-45fd-8594-1c3028cb2547 in Status: SUCCESS [ 992.718261] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 deletion is rescheduled due to dependency. [ 992.718261] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.977050] env[69360]: INFO networking_nsxv3.common.synchronization [None req-c8f8e27e-ee67-4fb7-ac97-a022a87c8d91 tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 994.977561] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 994.977872] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.977973] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.978057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.978310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.978470] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.044496] env[69360]: INFO networking_nsxv3.common.synchronization [None req-d14c11cf-c46e-4d32-ab65-0f6a66383787 tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 995.045140] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 995.045446] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.045578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.501505] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.501670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.501714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.501938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.502040] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.502142] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33593091-49d9-414e-a324-610485881658 already deleted. [ 995.502231] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.502416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.502589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.502677] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.024028] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.024028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.024028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.024028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.024028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.024028] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33593091-49d9-414e-a324-610485881658 already deleted. [ 996.024028] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.045771] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1000.046089] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1000.430449] env[69360]: INFO networking_nsxv3.common.synchronization [req-11205522-be53-454a-9480-ed1ece6e2c5f req-c2cbe3de-952f-4214-b6c9-e643555087bf tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1000.430976] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1000.431297] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.431429] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.431491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.431762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.431923] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.432043] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.432113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.432258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.432349] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.432450] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.659344] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-848 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.659555] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.659687] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.659962] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.660237] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.660400] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.660524] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.660744] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.660896] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.661550] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.661690] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1000.661810] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1000.661926] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1000.662181] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1000.662341] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1000.662485] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1000.684594] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1000.684594] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1000.684594] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1000.684880] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-848" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.685070] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-eaedef65-ee11-437f-981f-bde5612a3c8f taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.685249] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.685372] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.685704] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.685851] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaedef65-ee11-437f-981f-bde5612a3c8f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.934737] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.934908] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.934983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.935236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.935331] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.935614] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.935791] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.935938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.936085] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.936177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.936271] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33593091-49d9-414e-a324-610485881658 already deleted. [ 1000.936356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.188196] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.188612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.188612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.188824] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.188991] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.189138] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port eaedef65-ee11-437f-981f-bde5612a3c8f not found, creating... [ 1001.189424] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.189598] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.189719] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.189954] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.190108] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.190398] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.190553] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.190674] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.190878] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.191032] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.191178] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: eaedef65-ee11-437f-981f-bde5612a3c8f is going to be created. [ 1001.210359] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.210564] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.210680] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.210949] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.211204] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.211425] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.891528] env[69360]: INFO networking_nsxv3.common.synchronization [req-11205522-be53-454a-9480-ed1ece6e2c5f req-470223a4-5058-426f-9a1d-3eb4f355faae service nova] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 1001.891855] env[69360]: INFO networking_nsxv3.common.synchronization [req-11205522-be53-454a-9480-ed1ece6e2c5f req-470223a4-5058-426f-9a1d-3eb4f355faae service nova] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1001.892169] env[69360]: INFO networking_nsxv3.common.synchronization [req-11205522-be53-454a-9480-ed1ece6e2c5f req-470223a4-5058-426f-9a1d-3eb4f355faae service nova] Enqueued Resource ID: eaedef65-ee11-437f-981f-bde5612a3c8f with Priority: HIGHEST for action port [ 1001.892927] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_rules [ 1001.893112] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1001.893298] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaedef65-ee11-437f-981f-bde5612a3c8f with Priority: HIGHEST for action port [ 1001.893718] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.893911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.894041] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.894346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.894485] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.895763] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.895910] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.896052] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.896385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.896632] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.896798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.896911] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.897173] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.897326] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.897508] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.899027] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaedef65-ee11-437f-981f-bde5612a3c8f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.899159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.899261] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.899525] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.899662] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaedef65-ee11-437f-981f-bde5612a3c8f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.402137] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.402481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.402520] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.403839] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaedef65-ee11-437f-981f-bde5612a3c8f with status ACTIVE [ 1002.404044] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.404156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.404224] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.404439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.404553] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.404729] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.404829] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.404887] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.405058] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.405130] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.405318] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.405404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.405456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.405600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.405679] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.405812] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaedef65-ee11-437f-981f-bde5612a3c8f is going to be updated. [ 1002.428059] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.428059] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.428396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.428396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.428533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.428733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaedef65-ee11-437f-981f-bde5612a3c8f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.908789] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.410848] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.411220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.411220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.411295] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.411382] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.411491] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33593091-49d9-414e-a324-610485881658 is going to be created. [ 1003.433723] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.433918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.433918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.434154] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.434308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.444832] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33593091-49d9-414e-a324-610485881658 in Status: UNINITIALIZED for 2s [ 1005.455162] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33593091-49d9-414e-a324-610485881658 in Status: SUCCESS [ 1005.455472] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.455552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.455760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.455960] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.456098] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.456171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.456372] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.456461] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.456550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.456636] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.959158] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.461634] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33593091-49d9-414e-a324-610485881658: rpc.has_security_group_logging(os_id): False [ 1006.478919] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.479126] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.479190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.479359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.479452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.479698] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.479797] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.479857] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.480011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.480096] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.480184] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33593091-49d9-414e-a324-610485881658 is going to be created. [ 1006.536226] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.536436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.536436] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.536638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.536817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.547348] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33593091-49d9-414e-a324-610485881658 in Status: IN_PROGRESS for 2s [ 1006.894306] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1006.894488] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1008.560617] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33593091-49d9-414e-a324-610485881658 in Status: SUCCESS [ 1008.560907] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.896041] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1011.896435] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1016.897642] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1016.897993] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1021.899336] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1021.899711] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1026.900285] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1026.900285] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1029.852051] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1029.852476] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1031.901458] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1031.901895] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1036.902316] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1036.902731] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1041.903416] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1041.903801] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1045.801598] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.802066] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.802066] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.802184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.802240] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.305031] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.807261] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.904664] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1046.904761] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1047.309940] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1047.310157] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1048.028944] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.029400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.029400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.029500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.042179] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1048.043021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.043757] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1048.066682] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.066893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.066893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.067091] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.071367] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.071697] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1048.071782] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.071857] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1048.099192] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.099478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.099478] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.099598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.100263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.100428] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1048.145745] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.145979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.145979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.146160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.146343] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.146536] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1048.190011] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.190256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.190256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.190421] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.190608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.190838] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:13. [ 1048.190918] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'8bbf7ed1-077f-45c1-80ad-3d178d8b260f', '33593091-49d9-414e-a324-610485881658', 'cd08a380-9c77-45fd-8594-1c3028cb2547', '9f5a08b4-b8f3-450e-a7ff-21a94b955679', 'dfd13ad9-86ad-486c-98eb-041e0786ee19', 'c0fff936-6194-4f2d-9259-4eed178abd53', 'fb3729e4-b05d-4d6a-8a28-cf87f7fe4240', '1a911e52-5c7b-4b09-b418-a3af1764116f', '662bb1eb-3a7e-4a77-a000-23abf2831625', '5779f8c2-8142-43f8-8700-67010b902abd', '4c4bbd71-985d-4aad-9fb8-708c57945ecb', '93cab96c-004c-44eb-9939-8484814e8bbf', '4597f8d6-deda-4e64-918a-928b7361dad2'} {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.190986] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1048.209381] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.209638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.209638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.209786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.209873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.209989] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1048.210075] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.210148] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1048.253300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.253515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.253515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.253686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.254298] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.254489] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1048.254564] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1048.254668] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1048.254707] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1048.254762] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 13/13 resources of Type:Security Group Rules [ 1048.254829] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGH for action security_group_rules [ 1048.254909] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGH for action security_group_rules [ 1048.254974] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGH for action security_group_rules [ 1048.255048] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGH for action security_group_rules [ 1048.255109] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGH for action security_group_rules [ 1048.255170] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGH for action security_group_rules [ 1048.255229] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGH for action security_group_rules [ 1048.255289] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGH for action security_group_rules [ 1048.255348] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGH for action security_group_rules [ 1048.255403] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGH for action security_group_rules [ 1048.255455] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGH for action security_group_rules [ 1048.255516] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGH for action security_group_rules [ 1048.255575] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGH for action security_group_rules [ 1048.255641] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1048.255702] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1048.255874] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.255978] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.256050] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.256215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.256291] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.256458] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.256550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.256608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.256742] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.256812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.256978] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.257085] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.257145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.257277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.257347] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.257507] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.257595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.257653] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.257783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.257854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.258024] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.258114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.258170] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.258302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.258371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.258531] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.258616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.258674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.258802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.258873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.259044] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.259137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.259190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.259319] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.259391] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.259548] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.259633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.259689] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.259817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.259886] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.260087] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.260186] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.260245] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.260381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.260452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.260615] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.260706] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.260764] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.260915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.260988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.261208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.261266] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.261306] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.261430] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.261499] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.261659] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.261747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.261803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.261932] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.262009] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.262178] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.262265] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.262322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.262453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.262524] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.262681] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.262768] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.262840] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.262980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.263065] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.263228] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.263317] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.263374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.263503] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.263572] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.263731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.263820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.263873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.264016] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.264087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.264247] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.264335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.264392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.264520] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.264589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.264747] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.264834] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.264894] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.265038] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.265110] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.265271] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.265358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.265416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.265545] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.265613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.265771] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.265859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.265918] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.266060] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.266132] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.266289] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.266376] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.266433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.266563] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.266631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.266790] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.266879] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.266937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.267088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.267157] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.267317] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.267404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.267462] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.267592] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.267661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.267818] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.267906] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.267966] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.268109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.268179] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.268340] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.268427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.268484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.268612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.268680] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.268838] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.268927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.268984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.269125] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.269196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.269354] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.269443] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.269501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.269629] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.269698] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.269856] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.269945] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.270029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.270144] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.270213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.270433] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.270515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.270515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.270637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.270705] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.270804] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:14 [ 1048.270889] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 7 of least updated resources [ 1048.270969] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGH for action security_group_members [ 1048.271066] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGH for action security_group_members [ 1048.271137] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGH for action security_group_members [ 1048.271204] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGH for action security_group_members [ 1048.271269] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGH for action security_group_members [ 1048.271335] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGH for action security_group_members [ 1048.271400] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGH for action security_group_members [ 1048.271492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.905622] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1051.905905] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1051.905905] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f with Priority: HIGH for action security_group_rules [ 1051.906038] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd08a380-9c77-45fd-8594-1c3028cb2547 with Priority: HIGH for action security_group_rules [ 1051.906114] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 with Priority: HIGH for action security_group_rules [ 1051.906215] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea7482e-7e57-4680-8c8a-3228e37bba95 with Priority: HIGH for action security_group_members [ 1051.906311] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e with Priority: HIGH for action security_group_members [ 1051.906403] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e6f228-ab6c-4d13-b101-bef38530e43f with Priority: HIGH for action security_group_members [ 1051.906492] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55b27fd-fe87-4592-84d0-620efe1b57cf with Priority: HIGH for action security_group_members [ 1051.906605] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2703b410-f705-4fcc-9444-dcfc58a56134 with Priority: HIGH for action security_group_members [ 1051.906705] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 with Priority: HIGH for action security_group_members [ 1051.906793] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4f9a399-698a-42da-8c89-814b7c1e7204 with Priority: HIGH for action security_group_members [ 1051.906884] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4597f8d6-deda-4e64-918a-928b7361dad2 with Priority: HIGH for action security_group_rules [ 1051.906971] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93cab96c-004c-44eb-9939-8484814e8bbf with Priority: HIGH for action security_group_rules [ 1051.907081] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb with Priority: HIGH for action security_group_rules [ 1051.907170] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGH for action security_group_rules [ 1051.907255] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 with Priority: HIGH for action security_group_rules [ 1051.907338] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fff936-6194-4f2d-9259-4eed178abd53 with Priority: HIGH for action security_group_rules [ 1051.907422] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a911e52-5c7b-4b09-b418-a3af1764116f with Priority: HIGH for action security_group_rules [ 1051.907508] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 with Priority: HIGH for action security_group_rules [ 1051.907593] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGH for action security_group_rules [ 1051.907679] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 with Priority: HIGH for action security_group_rules [ 1051.908040] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.908175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.908243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.908459] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.908543] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8bbf7ed1-077f-45c1-80ad-3d178d8b260f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.909556] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd08a380-9c77-45fd-8594-1c3028cb2547 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.909678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.909746] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.909915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.909990] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd08a380-9c77-45fd-8594-1c3028cb2547',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.910982] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.911106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.911174] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.911325] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.911398] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb3729e4-b05d-4d6a-8a28-cf87f7fe4240',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.912100] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-fea7482e-7e57-4680-8c8a-3228e37bba95 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.912210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.912284] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.912433] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.912578] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.912720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.912720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.912863] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.912949] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.913060] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fea7482e-7e57-4680-8c8a-3228e37bba95',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.914656] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.914656] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.914656] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.914996] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.915485] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8e6f228-ab6c-4d13-b101-bef38530e43f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.915701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.915701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.915799] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.915959] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.916128] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.916206] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.916370] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.916455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.916538] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8e6f228-ab6c-4d13-b101-bef38530e43f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.917517] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-a55b27fd-fe87-4592-84d0-620efe1b57cf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.917660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.917731] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.917904] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.918057] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.918161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.918244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.918389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.918464] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.918555] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a55b27fd-fe87-4592-84d0-620efe1b57cf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.919250] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-2703b410-f705-4fcc-9444-dcfc58a56134 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.919359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.919425] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.919566] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.919700] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.919792] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.919853] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.919985] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.920073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.920152] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2703b410-f705-4fcc-9444-dcfc58a56134',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.920854] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9363c60-0dc4-4a51-8ca5-3290a7dda024 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.920979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.921073] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.921242] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.921406] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.921521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.921591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.921854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.921854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.921939] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9363c60-0dc4-4a51-8ca5-3290a7dda024',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.922732] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d4f9a399-698a-42da-8c89-814b7c1e7204 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.922877] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.922996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.923196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.923338] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.923589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.923589] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.923810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.923810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.923810] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d4f9a399-698a-42da-8c89-814b7c1e7204',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.924730] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4597f8d6-deda-4e64-918a-928b7361dad2 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.924848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.924952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.925108] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.925258] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4597f8d6-deda-4e64-918a-928b7361dad2',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.925951] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93cab96c-004c-44eb-9939-8484814e8bbf taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.926079] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.926148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.926298] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.926372] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93cab96c-004c-44eb-9939-8484814e8bbf',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.927149] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.927261] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.927328] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.927476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.927547] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c4bbd71-985d-4aad-9fb8-708c57945ecb',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.928427] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.928544] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.928612] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.928764] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.928836] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.929537] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-662bb1eb-3a7e-4a77-a000-23abf2831625 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.929643] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.929708] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929926] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('662bb1eb-3a7e-4a77-a000-23abf2831625',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.930950] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0fff936-6194-4f2d-9259-4eed178abd53 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.931181] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.931256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.931448] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.931688] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0fff936-6194-4f2d-9259-4eed178abd53',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.932435] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a911e52-5c7b-4b09-b418-a3af1764116f taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.932557] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.932626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.932778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.932852] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a911e52-5c7b-4b09-b418-a3af1764116f',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.933724] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfd13ad9-86ad-486c-98eb-041e0786ee19 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.933854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.933937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.934124] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.934201] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfd13ad9-86ad-486c-98eb-041e0786ee19',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.935194] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.935385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.935385] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.935517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.935595] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.936531] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.936650] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.936721] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.936868] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.936942] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f5a08b4-b8f3-450e-a7ff-21a94b955679',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.942192] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.942333] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.942404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.942583] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.942678] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.942860] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.942975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.943049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.943196] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.943272] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.943358] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fea7482e-7e57-4680-8c8a-3228e37bba95 is going to be deleted. [ 1051.968984] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.969172] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.969218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.969420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.982923] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.983145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.983190] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.983392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.983482] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.983582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fea7482e-7e57-4680-8c8a-3228e37bba95" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.988481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.988481] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb3729e4-b05d-4d6a-8a28-cf87f7fe4240 is going to be deleted. [ 1052.032848] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.033105] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.033105] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.033309] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.033400] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.033515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb3729e4-b05d-4d6a-8a28-cf87f7fe4240" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.440953] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.441165] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.441273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.441530] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.441630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.441839] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.441943] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.442033] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.442171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.442270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.442345] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a55b27fd-fe87-4592-84d0-620efe1b57cf is going to be deleted. [ 1052.443268] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.443394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.443463] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.443613] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.443691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.443871] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.443984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.444050] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.444197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.444258] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.444342] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e is going to be deleted. [ 1052.445172] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.445308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.445358] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.445492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.445570] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.445731] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.445826] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.445889] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.446037] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.446116] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.446197] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2703b410-f705-4fcc-9444-dcfc58a56134 is going to be deleted. [ 1052.450131] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.450232] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.450297] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.450446] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.450526] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.450691] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.450783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.450845] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.450984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.451075] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.451160] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9363c60-0dc4-4a51-8ca5-3290a7dda024 is going to be deleted. [ 1052.451911] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.452027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.452101] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.452250] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.452394] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.452494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.452582] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.452733] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.452812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.452894] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.453015] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.458461] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.458565] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.458638] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.458798] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.458942] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.459049] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.459115] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.459257] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.459337] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.459420] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.459519] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.460402] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.460611] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.460684] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.460841] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.460934] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.461126] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.461222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.461296] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.461455] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.461549] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.461636] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d4f9a399-698a-42da-8c89-814b7c1e7204 is going to be deleted. [ 1052.465060] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.465180] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.465239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.465418] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.465512] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.465692] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.465785] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.465846] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.465986] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.466074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.466158] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8e6f228-ab6c-4d13-b101-bef38530e43f is going to be deleted. [ 1052.476719] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.520951] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.521171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.521171] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.521412] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.525222] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.525413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.526096] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.526199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.526885] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.527037] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.527738] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.527838] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.528506] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.528603] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.529610] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.529715] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.530408] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.530513] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.531248] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.531356] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.544896] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.545068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.545114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.545302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.545396] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.545494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8e6f228-ab6c-4d13-b101-bef38530e43f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546316] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.546425] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.546491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.546649] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.546729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2703b410-f705-4fcc-9444-dcfc58a56134" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.547476] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.547855] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.547961] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.548048] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.548207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.548288] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.548378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-158ea1d8-f319-4f38-b1fb-2a5c5bc0df4e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.548947] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.549325] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.549435] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.549501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.549663] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.549743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.549833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9363c60-0dc4-4a51-8ca5-3290a7dda024" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.550339] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.550729] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.550836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.550923] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.551184] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.551268] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551357] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a55b27fd-fe87-4592-84d0-620efe1b57cf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.551908] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.552280] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.552479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.552479] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.552664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.552664] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.552757] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d4f9a399-698a-42da-8c89-814b7c1e7204" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.553485] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.553879] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.553958] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.554562] env[69360]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1052.554946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.555109] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93cab96c-004c-44eb-9939-8484814e8bbf is going to be deleted. [ 1052.555979] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.556157] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.574670] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.574809] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a911e52-5c7b-4b09-b418-a3af1764116f is going to be deleted. [ 1052.575716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.575927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.595111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.595274] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfd13ad9-86ad-486c-98eb-041e0786ee19 is going to be deleted. [ 1052.596177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.596392] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.614322] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.614492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.620404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.620548] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8bbf7ed1-077f-45c1-80ad-3d178d8b260f is going to be deleted. [ 1052.621546] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.621770] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.643599] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.643806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.644717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.644850] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd08a380-9c77-45fd-8594-1c3028cb2547 is going to be deleted. [ 1052.645752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.645968] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.696723] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.696972] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.713595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.713791] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4597f8d6-deda-4e64-918a-928b7361dad2 is going to be deleted. [ 1052.714714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.714950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.721515] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.721671] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.789129] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.789294] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f5a08b4-b8f3-450e-a7ff-21a94b955679 is going to be deleted. [ 1052.790223] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.790442] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.816538] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.816737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.833578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.833846] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c4bbd71-985d-4aad-9fb8-708c57945ecb is going to be deleted. [ 1052.834744] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.834968] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.905717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.906061] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0fff936-6194-4f2d-9259-4eed178abd53 is going to be deleted. [ 1052.906831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.907062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.974380] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.983965] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33593091-49d9-414e-a324-610485881658: rpc.has_security_group_logging(os_id): False [ 1053.002475] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.002691] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.020810] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.021034] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.027387] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.027577] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.028452] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.028580] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 662bb1eb-3a7e-4a77-a000-23abf2831625 is going to be deleted. [ 1053.029981] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.030114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.030188] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.030397] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.030485] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.030608] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f5a08b4-b8f3-450e-a7ff-21a94b955679" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.030747] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.030898] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.030988] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.031122] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93cab96c-004c-44eb-9939-8484814e8bbf" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.031243] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.031389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.031463] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.031581] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a911e52-5c7b-4b09-b418-a3af1764116f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.031710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.031853] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.031927] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032054] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfd13ad9-86ad-486c-98eb-041e0786ee19" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.032717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.032792] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.032905] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8bbf7ed1-077f-45c1-80ad-3d178d8b260f" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.033145] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.033299] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.033377] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.033491] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd08a380-9c77-45fd-8594-1c3028cb2547" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.033604] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.033743] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.033820] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.033925] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4597f8d6-deda-4e64-918a-928b7361dad2" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.034088] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.034239] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.034315] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.034411] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c4bbd71-985d-4aad-9fb8-708c57945ecb" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.034519] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.034658] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.088302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.088612] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.088736] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.088803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.089027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.089106] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.089260] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33593091-49d9-414e-a324-610485881658 is going to be updated. [ 1053.156566] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.156780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.156780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.156996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.157111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.157236] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-662bb1eb-3a7e-4a77-a000-23abf2831625" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.164218] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.164406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.164406] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.164626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.164713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.164831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0fff936-6194-4f2d-9259-4eed178abd53" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.208252] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.208506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.208506] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.208660] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.208805] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.253796] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33593091-49d9-414e-a324-610485881658 in Status: IN_PROGRESS for 2s [ 1053.476500] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5779f8c2-8142-43f8-8700-67010b902abd: rpc.has_security_group_logging(os_id): False [ 1053.506726] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.506955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.506955] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.507193] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.531996] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.532330] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.532460] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.532529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.532737] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.532827] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.532921] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5779f8c2-8142-43f8-8700-67010b902abd is going to be updated. [ 1053.590885] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.591155] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.591155] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.591340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.591490] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.604487] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: IN_PROGRESS for 2s [ 1055.267152] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33593091-49d9-414e-a324-610485881658 in Status: SUCCESS [ 1055.267571] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.618300] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: SUCCESS [ 1055.618552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.908320] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1056.908685] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1061.909030] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1061.909416] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1066.910046] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1066.910046] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1071.910845] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1071.910845] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1076.911587] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1076.911999] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1077.299531] env[69360]: INFO networking_nsxv3.common.synchronization [req-0d930da0-0210-482d-8a98-5673c52f7a1b req-a0ec5581-d678-479a-b887-0635c09618ae tempest-AttachVolumeTestJSON-513705930 tempest-AttachVolumeTestJSON-513705930-project-member] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1077.300098] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGHEST for action security_group_members [ 1077.300412] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.300536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.300719] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.300926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.301098] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.301222] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.301289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.301441] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.301535] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.301639] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.804923] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.805168] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.805259] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.805521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.805595] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.805739] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.805839] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.805900] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.806074] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.806163] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.806251] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33593091-49d9-414e-a324-610485881658 is going to be updated. [ 1077.842406] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.842626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.842626] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.842817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.842963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.852179] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33593091-49d9-414e-a324-610485881658 in Status: IN_PROGRESS for 2s [ 1079.862801] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33593091-49d9-414e-a324-610485881658 in Status: SUCCESS [ 1079.863198] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33593091-49d9-414e-a324-610485881658 deletion is rescheduled due to dependency. [ 1079.863198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.301665] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1082.302066] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1087.302640] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1087.302930] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1092.303853] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1092.304323] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1097.304721] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1097.305169] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1102.305659] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1102.306111] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1107.306760] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1107.307188] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1112.307998] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1112.307998] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1117.309086] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1117.309537] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1122.311111] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.311487] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1127.315179] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.315473] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1132.316564] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.317034] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1137.317504] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1137.317504] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1142.318994] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1142.319441] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1147.319926] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1147.320390] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1152.321631] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1152.322071] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1157.323019] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1157.323398] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1162.324238] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1162.324663] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1167.325446] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1167.325815] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1172.326981] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1172.326981] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1177.328188] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.328615] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1182.329675] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.330148] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1187.331410] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1187.331775] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1192.332812] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1192.333102] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1197.334513] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1197.334892] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1202.336433] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.336892] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1207.337455] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.337851] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1212.338960] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1212.339411] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1217.340336] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.340757] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1222.342076] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1222.342458] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1227.343660] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1227.344140] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1232.345310] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.345678] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.347145] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.347553] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1242.348234] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.348711] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1247.349396] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1247.349771] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.351101] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1252.351101] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1257.352034] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.352411] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.353679] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1262.354127] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1267.354926] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.355353] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1269.853187] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1269.853580] env[69360]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9d1c19f5-4a74-4517-b4e8-2d0b9523c1dd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1272.356684] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1272.357153] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.358243] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.358672] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1282.359722] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.360163] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.803273] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.803714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.803714] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.803878] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.804029] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.307086] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.809515] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.312399] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1287.312597] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1287.361075] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.361237] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.168116] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.168587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.168587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.168587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.181614] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1288.182458] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.183267] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1288.212296] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.212515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.212515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.212696] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.217164] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.217513] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1288.217595] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.217675] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1288.240082] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.240314] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.240314] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.240538] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.240804] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.240904] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1288.281192] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.281413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.281413] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.281605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.281763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.281929] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1288.318301] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.318578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.318578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.318720] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.318882] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.319072] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:2. [ 1288.319153] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'33593091-49d9-414e-a324-610485881658', '5779f8c2-8142-43f8-8700-67010b902abd'} {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.319228] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1288.338358] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.338729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.338729] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.338864] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.338864] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.338955] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1288.339025] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.339099] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1288.383808] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.383983] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.384047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.384247] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.384687] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.384859] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1288.384938] env[69360]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=69360) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1288.385014] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1288.385082] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1288.385154] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 2/2 resources of Type:Security Group Rules [ 1288.385226] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGH for action security_group_rules [ 1288.385308] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGH for action security_group_rules [ 1288.385379] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 1288.385443] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 1288.385623] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.385728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.385803] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.385949] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.386035] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.386233] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.386342] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.386389] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.386533] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.386605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.386770] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.386859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.386915] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.387064] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.387138] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.387301] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.387410] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.387486] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.387630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.387702] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.387866] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.387956] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.388024] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.388160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.388255] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.388429] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.388521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.388580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.388716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.388786] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.388946] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.389047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.389109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.389262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.389338] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.389501] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.389591] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.389646] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.389779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.389849] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.390014] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.390111] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.390173] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.390327] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.390404] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.390569] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.390783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.390783] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.390895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.390895] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.391068] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.391159] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.391212] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.391344] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.391416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.391573] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.391661] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.391717] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.391848] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.391916] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.392087] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.392175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.392228] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.392360] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.392431] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.392606] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.392753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.392753] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.392875] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.392945] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.393116] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.393207] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.393273] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.393416] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.393489] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.393651] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.393740] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.393796] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.393926] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.393995] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.394167] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.394256] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.394315] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.394445] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.394514] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.394673] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.394762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.394817] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.394946] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.395026] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.395186] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.395276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.395334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.395461] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.395531] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.395690] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.395780] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.395836] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.395963] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.396047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.396222] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.396321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.396381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.396517] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.396588] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.396686] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:7 [ 1288.396753] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Refreshing 7 of least updated resources [ 1288.396830] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGH for action security_group_members [ 1288.396912] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGH for action security_group_members [ 1288.396979] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGH for action security_group_members [ 1288.397057] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGH for action security_group_members [ 1288.397125] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGH for action security_group_members [ 1288.397190] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGH for action security_group_members [ 1288.397258] env[69360]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGH for action security_group_members [ 1288.397346] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.362535] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1292.362937] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=9], Jobs=0 [ 1292.362937] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33593091-49d9-414e-a324-610485881658 with Priority: HIGH for action security_group_rules [ 1292.362937] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b with Priority: HIGH for action security_group_members [ 1292.363067] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGH for action security_group_members [ 1292.363102] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbde8810-49af-4182-a254-894a61c0037e with Priority: HIGH for action security_group_members [ 1292.363186] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3694c3f2-85a3-493d-8c83-767e017321ab with Priority: HIGH for action security_group_members [ 1292.363286] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa with Priority: HIGH for action security_group_members [ 1292.363377] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e5a270-0e63-466e-949b-b541894e9b16 with Priority: HIGH for action security_group_members [ 1292.363470] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5779f8c2-8142-43f8-8700-67010b902abd with Priority: HIGH for action security_group_rules [ 1292.363560] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0fbef34-d753-4a4a-92ea-55434312119d with Priority: HIGH for action security_group_members [ 1292.363897] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33593091-49d9-414e-a324-610485881658 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.364039] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.364107] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.364322] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.364407] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33593091-49d9-414e-a324-610485881658',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.365428] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d8489e0-bcca-4116-a053-e2f77ca08a2b taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.365573] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.365632] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.365778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.365955] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.366044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.366079] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.366224] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.366309] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.366402] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d8489e0-bcca-4116-a053-e2f77ca08a2b',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.367290] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.367395] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.367463] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.367755] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.367755] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.367876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.367876] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.367997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.368087] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.368169] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.369097] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbde8810-49af-4182-a254-894a61c0037e taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.369215] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.369311] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.369465] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.371046] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.371046] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbde8810-49af-4182-a254-894a61c0037e',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.371046] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-3694c3f2-85a3-493d-8c83-767e017321ab taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.371046] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.371454] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.371454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.371454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.371454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.371454] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.371844] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3694c3f2-85a3-493d-8c83-767e017321ab',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.372201] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-134f4dd0-da38-412e-8a3e-b3a08f7896fa taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.372305] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.372388] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.372503] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.372641] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.372790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.372790] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.372912] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.372984] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.373077] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134f4dd0-da38-412e-8a3e-b3a08f7896fa',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.373783] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5e5a270-0e63-466e-949b-b541894e9b16 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.373894] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.373975] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.374134] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.374273] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.374580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.374580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.374580] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.374695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.374725] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5e5a270-0e63-466e-949b-b541894e9b16',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.375547] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.375658] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.375811] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.375870] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.375955] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.376696] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0fbef34-d753-4a4a-92ea-55434312119d taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.376801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.376873] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.377029] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.377168] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.377262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.377321] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.377457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.377727] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.377727] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0fbef34-d753-4a4a-92ea-55434312119d',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.397991] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.398209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.398209] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.398439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.417497] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.417654] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33593091-49d9-414e-a324-610485881658 is going to be deleted. [ 1292.473847] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.474021] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.474142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.474290] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.474381] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.474500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33593091-49d9-414e-a324-610485881658" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.879618] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.879812] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.879858] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.880077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.880173] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.880381] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.880481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.880547] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.880697] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.880775] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.880860] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3694c3f2-85a3-493d-8c83-767e017321ab is going to be deleted. [ 1292.881942] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.882068] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.882137] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.882294] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.882374] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.882538] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.882631] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.882690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.882827] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.882941] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.883075] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbde8810-49af-4182-a254-894a61c0037e is going to be deleted. [ 1292.883836] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.883959] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.884032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.884161] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.884238] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.884400] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.884494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.884554] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.884690] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.884762] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.884843] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 is going to be deleted. [ 1292.885646] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5779f8c2-8142-43f8-8700-67010b902abd taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.885752] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.885822] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.885952] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.886103] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.886198] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.886263] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.886402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.886476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.886555] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.886642] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.887562] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.887674] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.887760] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.887921] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.888015] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.888179] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.888299] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.888361] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.888492] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.888566] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.888666] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d8489e0-bcca-4116-a053-e2f77ca08a2b is going to be deleted. [ 1292.891300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.891470] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.891536] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.891637] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.891745] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.891952] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.892077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.892144] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.892320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.892402] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.892488] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5e5a270-0e63-466e-949b-b541894e9b16 is going to be deleted. [ 1292.893300] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.893403] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.893469] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.893616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.893694] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.893856] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.893950] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.894076] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.894160] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.894234] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.894343] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134f4dd0-da38-412e-8a3e-b3a08f7896fa is going to be deleted. [ 1292.895134] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.895241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.895310] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.895458] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.895537] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.895700] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.895793] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.895854] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.895990] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.896077] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.896160] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0fbef34-d753-4a4a-92ea-55434312119d is going to be deleted. [ 1292.957144] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.957380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.957380] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.957606] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.957703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.957801] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134f4dd0-da38-412e-8a3e-b3a08f7896fa" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.958686] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.958797] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.958862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.959032] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.959117] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.959210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbde8810-49af-4182-a254-894a61c0037e" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.959869] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.959981] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.960062] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.960220] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.960301] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.960393] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.960994] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.961114] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.961183] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.961334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.961415] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.961504] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3694c3f2-85a3-493d-8c83-767e017321ab" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.962144] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.962252] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.962320] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.962469] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.962548] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.962639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0fbef34-d753-4a4a-92ea-55434312119d" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.963277] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.963386] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.963453] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.963598] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.963676] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.963763] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d8489e0-bcca-4116-a053-e2f77ca08a2b" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.964404] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.964511] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.964578] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.964723] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.964802] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.964890] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5e5a270-0e63-466e-949b-b541894e9b16" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.392461] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5779f8c2-8142-43f8-8700-67010b902abd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.894771] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5779f8c2-8142-43f8-8700-67010b902abd: rpc.has_security_group_logging(os_id): False [ 1293.913263] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.913521] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.913633] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.913964] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.932434] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.932732] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.932859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.932909] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.933133] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.933218] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.933329] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5779f8c2-8142-43f8-8700-67010b902abd is going to be updated. [ 1294.004666] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.004885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.004885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.005142] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.005289] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.017890] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: IN_PROGRESS for 2s [ 1296.031727] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5779f8c2-8142-43f8-8700-67010b902abd in Status: SUCCESS [ 1296.033564] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5779f8c2-8142-43f8-8700-67010b902abd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.365186] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.365598] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1302.366946] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1302.366946] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.367939] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1307.367939] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1312.369492] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.369912] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1317.370947] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.371371] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1322.371950] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.372397] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.373717] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.374216] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.238795] env[69360]: INFO networking_nsxv3.common.synchronization [req-3ba0d135-9c5e-47e2-9536-fa397f95ebd2 req-8d3a4b6e-9501-4778-9f7a-18c6ff95acd7 tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 1332.239302] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 with Priority: HIGHEST for action security_group_members [ 1332.239610] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5 taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.239739] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.239810] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.240724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.240724] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.240724] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.241011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.241011] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.241086] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.241232] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57cf0f6c-869d-4d08-b17d-3fb1a59953c5',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.743770] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.743931] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.743998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.744244] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.744340] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.744540] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.744642] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.744708] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.744859] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.744937] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.745042] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57cf0f6c-869d-4d08-b17d-3fb1a59953c5 already deleted. [ 1332.745123] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57cf0f6c-869d-4d08-b17d-3fb1a59953c5" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.082685] env[69360]: INFO networking_nsxv3.common.synchronization [None req-a84a107f-a79b-4858-ad01-3b00f3cd1d15 tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1333.083269] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1333.083575] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.083701] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.083771] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.084036] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.084125] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.156872] env[69360]: INFO networking_nsxv3.common.synchronization [None req-6badd488-a114-489d-adf2-18ce5ffc5a6c tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1333.157374] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1333.157678] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.157781] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.604208] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.604600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.604600] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.604679] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.604713] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.604813] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a already deleted. [ 1333.604896] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.605058] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.605213] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.605301] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.125923] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.126177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.126177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.126359] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.126435] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.126539] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a already deleted. [ 1334.126619] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.158548] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.158855] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1338.653314] env[69360]: INFO networking_nsxv3.common.synchronization [req-71920fad-e386-45af-b24b-3144d4cdd21a req-62207d4d-8787-4348-87e3-b915cc4f51ac tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1338.653843] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1338.654156] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.654378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.654378] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.654587] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.654738] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.654831] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.654892] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.655044] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.655127] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.655215] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.936372] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.936578] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.936709] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.937012] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.937299] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.937470] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.937596] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.937830] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.937984] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.938250] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.938372] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1338.938489] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1338.938604] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1338.938720] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1338.938829] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1338.939016] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1338.960489] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1338.960685] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1338.960798] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1338.960981] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.961315] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.961493] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.961616] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.961951] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.962119] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81716a44-ac7c-4a0a-92b5-533f7e8af4fd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.157139] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.157394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.157394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.157627] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.157728] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.157936] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.158054] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.158113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.158270] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.158349] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.158436] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a already deleted. [ 1339.158515] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.464247] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.464655] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.464655] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.464859] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.464990] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.465187] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Segment Port 81716a44-ac7c-4a0a-92b5-533f7e8af4fd not found, creating... [ 1339.465434] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.465596] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.465719] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.465950] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.466106] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.466391] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.466551] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.466673] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.466901] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.467091] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.467244] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd is going to be created. [ 1339.488710] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.488993] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.489187] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.489367] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.489649] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.489889] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [req-71920fad-e386-45af-b24b-3144d4cdd21a req-e83f8e35-4b53-41b0-82d6-d24c038475e9 service nova] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [req-71920fad-e386-45af-b24b-3144d4cdd21a req-e83f8e35-4b53-41b0-82d6-d24c038475e9 service nova] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [req-71920fad-e386-45af-b24b-3144d4cdd21a req-e83f8e35-4b53-41b0-82d6-d24c038475e9 service nova] Enqueued Resource ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with Priority: HIGHEST for action port [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1340.156336] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with Priority: HIGHEST for action port [ 1340.156798] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.157152] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.157368] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.157686] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.157967] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.158893] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.159175] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.159335] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.159586] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.159824] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.160051] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.160210] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.160439] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.160605] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.161015] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.161623] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.162377] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.162456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.163924] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.163924] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81716a44-ac7c-4a0a-92b5-533f7e8af4fd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.665085] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.666230] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.666371] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.666504] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with status ACTIVE [ 1340.666662] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.666778] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.666833] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.667056] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.667149] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.667319] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.667417] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.667476] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.667630] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.667710] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.667886] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.667977] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.668047] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.668197] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.668262] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.668339] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd is going to be updated. [ 1340.689445] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.689639] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.689681] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.689862] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.689998] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.690181] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.170707] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.673587] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.674019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.674019] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.674104] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.674148] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.674236] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a is going to be created. [ 1341.699807] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.699997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.699997] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.700241] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.700409] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.709598] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: UNINITIALIZED for 2s [ 1343.720901] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: SUCCESS [ 1343.721276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.721276] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.721500] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.721691] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.721806] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.721864] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.722027] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.722113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.722193] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.722283] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.224857] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.727550] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5925595c-74bf-456f-aa7f-83a8a8928c9a: rpc.has_security_group_logging(os_id): False [ 1344.745550] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.745550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.745550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.745550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.745550] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.745938] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.745938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.745938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.745938] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.746155] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.746155] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a is going to be created. [ 1344.806064] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.806277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.806277] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.806502] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.806685] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.817745] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: IN_PROGRESS for 2s [ 1345.156662] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.156898] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1346.830771] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: SUCCESS [ 1346.831195] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.158176] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.158517] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1355.159617] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.159993] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1360.161067] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.161480] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1365.162520] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1365.162939] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1370.163556] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1370.163982] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1375.165056] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1375.165437] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1380.166351] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.166728] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1385.168029] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.168451] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.168745] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.169229] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.170458] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.170950] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.171538] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.171538] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.172661] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.173081] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.174229] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.174614] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.275865] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock network-482 taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.276151] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.276250] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.276501] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.276766] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.276927] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.277063] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.277290] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.277444] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.277698] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1412.277846] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] NeedRegenerationException {{(pid=69360) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1412.277960] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] no value, waiting for create lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1412.278086] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] value creation lock acquired {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1412.278211] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] No value present for key: 'zone-id' {{(pid=69360) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1412.278321] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Calling creation function for not-yet-present value {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1412.278458] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1412.326644] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1412.326875] env[69360]: DEBUG dogpile.cache.region [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=69360) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1412.327052] env[69360]: DEBUG dogpile.lock [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Released creation lock {{(pid=69360) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1412.327302] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "network-482" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.327693] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd taken with stack trace [, , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.327936] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.328121] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.328449] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.328617] env[69360]: DEBUG networking_nsxv3.api.rpc [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81716a44-ac7c-4a0a-92b5-533f7e8af4fd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.831173] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.831425] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.831579] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.831857] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.832025] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.832328] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.832490] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.832612] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.832836] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.832979] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.833278] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.833436] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.833581] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.833776] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.833912] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.834070] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Resource: SegmentPort with ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd is going to be updated. [ 1412.854224] env[69360]: DEBUG networking_nsxv3.common.locking [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.854442] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.854557] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.854811] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.855011] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.855245] env[69360]: DEBUG oslo_concurrency.lockutils [None req-4649cc62-bb0d-4c45-af29-aedb922c9858 None None] Releasing lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.557830] env[69360]: INFO networking_nsxv3.common.synchronization [req-2c602a22-9aff-48eb-bce8-eb986ab8ff45 req-c556e9f3-1532-49cb-b547-59022cd1964e service nova] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1413.558180] env[69360]: INFO networking_nsxv3.common.synchronization [req-2c602a22-9aff-48eb-bce8-eb986ab8ff45 req-c556e9f3-1532-49cb-b547-59022cd1964e service nova] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1413.558258] env[69360]: INFO networking_nsxv3.common.synchronization [req-2c602a22-9aff-48eb-bce8-eb986ab8ff45 req-c556e9f3-1532-49cb-b547-59022cd1964e service nova] Enqueued Resource ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with Priority: HIGHEST for action port [ 1413.558524] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_rules [ 1413.558592] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1413.558710] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with Priority: HIGHEST for action port [ 1413.559721] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.559893] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.560013] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.560177] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.560257] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.562625] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.562625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.562625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.562625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.562625] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.562625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.562625] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.562892] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.562892] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.562892] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.563605] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.563716] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.563779] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.563930] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.564053] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81716a44-ac7c-4a0a-92b5-533f7e8af4fd',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.066382] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.066628] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.066737] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.067728] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 81716a44-ac7c-4a0a-92b5-533f7e8af4fd with status ACTIVE [ 1414.068427] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.068427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.068427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.068427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.068427] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.068681] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.068726] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.068808] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.069072] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.069169] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.069358] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.069457] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.069516] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.070040] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.070040] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.070040] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 81716a44-ac7c-4a0a-92b5-533f7e8af4fd is going to be updated. [ 1414.090180] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.090456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.090456] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.090566] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.090725] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.090885] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81716a44-ac7c-4a0a-92b5-533f7e8af4fd" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.572629] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.075719] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.075968] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.075968] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.076199] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.076302] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.076404] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a is going to be updated. [ 1415.109235] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.109493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.109493] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.109636] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.109781] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.118237] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: IN_PROGRESS for 2s [ 1417.129104] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: SUCCESS [ 1417.129508] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.129552] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.129749] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.129976] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.130126] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.130187] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.130324] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.130407] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.130494] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.130586] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.633146] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1418.135435] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5925595c-74bf-456f-aa7f-83a8a8928c9a: rpc.has_security_group_logging(os_id): False [ 1418.152958] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.153182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.153182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.153394] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.153481] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.153725] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.153835] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.153980] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.154078] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.154156] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.154256] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a is going to be updated. [ 1418.212868] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.213113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.213113] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.213334] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.213501] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.225100] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: IN_PROGRESS for 2s [ 1418.560214] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.560492] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1420.243291] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: SUCCESS [ 1420.243693] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.561421] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.561765] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.563082] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.563469] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.564201] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.564661] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.566110] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.566488] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.567334] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.567742] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.568721] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.569176] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.569813] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.570209] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.570940] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.571390] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.571977] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.572410] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.737233] env[69360]: INFO networking_nsxv3.common.synchronization [req-e6ff10cf-700b-4db1-8c10-6f765cdd0e6c req-ff5ffa22-bc04-44e1-ab1b-5d6c768e64c7 tempest-AttachVolumeShelveTestJSON-525996393 tempest-AttachVolumeShelveTestJSON-525996393-project-member] Enqueued Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1466.737768] env[69360]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a with Priority: HIGHEST for action security_group_members [ 1466.738137] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock member-5925595c-74bf-456f-aa7f-83a8a8928c9a taken with stack trace [, , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.738232] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.738318] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.738484] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.738656] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.738776] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.738855] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.738960] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.739182] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.739294] env[69360]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5925595c-74bf-456f-aa7f-83a8a8928c9a',) {} {{(pid=69360) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.242223] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.242529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.242529] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.242616] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.242703] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.242908] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.243043] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.243109] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.243231] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.243308] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.243394] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a is going to be updated. [ 1467.273817] env[69360]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=69360) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.274057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.274057] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.274267] env[69360]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.274419] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.290330] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: IN_PROGRESS for 2s [ 1469.301267] env[69360]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a in Status: SUCCESS [ 1469.301695] env[69360]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5925595c-74bf-456f-aa7f-83a8a8928c9a deletion is rescheduled due to dependency. [ 1469.301695] env[69360]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5925595c-74bf-456f-aa7f-83a8a8928c9a" {{(pid=69360) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.738889] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.739331] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.739912] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.739912] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.741344] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.741885] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.742589] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.742911] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1491.743961] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.744391] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.745307] env[69360]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.745705] env[69360]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0